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PREFACE 

Although  the  Health  Standards  and  Quality  Bureau  (HSQB)  had  previously 
funded  several  special  projects  in  ambulatory  care  quality  assurance, 
the  Bureau  initiated  a  systematic  investigation  of  formal  ambulatory 
care  review  programs  in  1975.    Findings  of  this  investigation*  highlighted 
the  need  for  careful  examination  of  alternative  ambulatory  care  review 
approaches  to  determine  their  feasibility,  especially  in  the  PSRO 
environment. 

In  1976,  under  the  guidance  of  Michael  Goran,  M.D.,  former  Director, 
HSQB,  a  demonstration  program  was  initiated  to  further  examine  ambulatory 
care  review  methods  within  Professional  Standards  Review  Organizations. 

On  July  1,  1976  a  letter  from  HSQB  was  sent  to  all  the  PSROs  invit- 
ing them  to  participate  in  an  ambulatory  care  review  demonstration  pro- 
ject.   These  letters  specified  that  "the  demonstrations  will  be  designed 
to  assess  various  approaches  to  ambulatory  care  quality  assurance  in  a 
variety  of  health  service  delivery  systems  with  substantial  variety  in 
the  method  of  obtaining  a  rational  PSRO  coordination  approach  for  each 
project."    Five  demonstration  projects  were  selected  to  participate  in 
the  demonstration  project.    Representing  a  variety  of  locations  and 
proposed  methods  the  five  projects  began  formal  planning  activities  in 
early  October  1976.    The  demonstration  projects  are  Central  Massachusetts 
PSRO,  Bronx  PSRO,  Southcentral  Pennsylvania  PSRO,  Multnomah  Foundation 
for  Medical  Care,  and  New  Mexico  PSRO. 

At  the  same  time  as  the  demonstration  projects  were  being  selected 
an  analysis  contractor  was  selected  to  "assist  PSRO  in  developing  the 
demonstration  protocols  and  be  responsible  for  assessment  and  analysis 

Contract  No.  240-75-0101,  Bureau  of  Quality  Assurance,  Health  Services 
Administration. 
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of  the  effectiveness  of  each  of  the  demonstration  projects  in  conjunction 
with  the  PSROs."    Health  Care  Management  Systems,  Inc.  (HCMS)  has  performed 
as  the  ambulatory  demonstration  analysis  contractor  since  July,  1976. 
HCMS  was  also  involved  in  a  three-year  grant  program  funded  by  The 
Robert  Wood  Johnson  Foundation  to  examine  ambulatory  quality  assurance 
programs  with  special  emphasis  on  information  systems.    Some  funding 
provided  by  the  Foundation  grant  was  used  to  give  a  private  perspective 
to  the  government-funded  demonstration  project  and  to  synthesize  results 
of  the  project  with  other  ambulatory  care  quality  assurance  research  and 
evaluation  programs  in  which  HCMS  was  engaged. 

This  report  on  the  development  of  ambulatory  care  review  methods  in 
the  five  PSROs  demonstration  projects  is  in  partial  fulfillment  of  the 
analysis  contract  requirements.    The  report  includes  two  volumes  and 
two  appendices: 

Volume     I:    Program  Overview  and  Discussion 
Section     1:    Bronx  PSRO 

2:    Central  Massachusetts  PSRO 

3:    Multnomah  Foundation  for  Medical  Care 

4:    New  Mexico  PSRO 

5:    Southcentral  Pennsylvania  PSRO 

Policy  Recommendations  and  Technical  Guidelines 


Volume  II 


Appendix  1 


Interim  Report  -  Cooperative  Demonstration  and  Analysis 
of  Ambulatory  Care  Quality  Assurance  Review  Methodology 
in  PSRO  Settings  -  November  1977 


Appendix     2:    Ambulatory  Medical  Care  Quality  Assurance  1977  Conference 
Proceedings,  La  Jolla  Health  Science  Publications,  La 
Jolla,  California  1977 
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Project  overviews  and  data  for  each  of  the  demonstration  projects  are 
documented  in  Volume  I.    This  volume  is  especially  useful  as  examples  of 
ambulatory  care  review  developmental  efforts  in  PSRO.    Volume  II,  "Policy 
Recommendations  and  Technical  Guidelines"  are  directed  to  HSQB  and  other 
agencies  involved  in  medical  care  quality  assurance  and  utilization 
review  in  a  regulatory  environment.    The  appendices  include  the  Interim 
Report  which  describes  the  first  year  demonstration  project  activity 
and  findings.    The  second  appendix  is  a  book  containing  papers  presented 
at  a  two-day  national  conference  on  ambulatory  care  quality  assurance. 
The  entire  report  is  designed  to  assist  organizations  searching  for 
feasible  ambulatory  care  review  alternatives. 
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Assessment  activities  conducted  in  each  of  the  five  Professional 
Standards  Review  Organization  (PSRO)  ambulatory  review  projects  were 
concentrated  in  several  areas:    a)  description  of  project  administration, 

b)  description  of  activities  in  the  areas  of  planning  and  administration, 
topic  selection,  criteria  development,  data  collection,  data  processing, 
review  and  decision  making,  feedback  and  intervention,  and  restudy,  and 

c)  description  of  resources  expended  to  accomplish  the  project's  goals. 

The  general  objectives  of  this  final  report  are  to: 

1.  Summarize  the  PSRO  activity  by  presenting  a  variety  of 
descriptive  documentation  (Volume  I). 

2.  Document  findings  of  investigation  of  review  techniques 
employed  by  each  PSRO  (Volume  I). 

3.  Guide  future  technical  assistance  conducted  by  HSQB 
(Volume  II). 

4.  Provide  recommendations  regarding  implementation  of  ambu- 
latory care  review  systems  by  current  and  future  PSRO 
demonstration  projects  (Volume  II). 

Presented  in  this  volume  first  is  a  brief  program  overview  designed 
to  acquaint  the  reader  with  each  PSRO  project.    If  more  in-depth  informa- 
tion is  desired,  either  the  site  itself  or  HCMS  can  provide  a  more 
detailed  description.    The  next  three  sections  describe  activities  that 
occurred  at  each  project  and  the  results  of  these  activities.  Finally, 
the  last  section  presents  resource  data  for  each  PSRO  site. 

Of  the  five  PSROs  funded  in  the  demonstration  program,  four  are 
initiating  ambulatory  care  review  systems  where  no  prior  system  existed. 
They  are:    Central  Massachusetts  PSRO,  Bronx  PSRO,  Southcentral  Pennsylvania 
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PSRO,  and  Multnomah  Foundation  for  Medical  Care.    The  fifth  demonstration 
program,  New  Mexico  PSRO,  has  operated  a  claim-based  review  system  for 
several  years  under  contract  with  the  State  Medicaid  agency.    The  New 
Mexico  PSRO  demonstration  has  explored  some  specific  review  questions, 
most  of  which  were  research  oriented. 

HCMS  data  collection  for  this  report  has  continued  since  the 
beginning  of  the  demonstration  project.    Each  project  has  cooperated 
in  providing  many  different  types  of  data  including  questionnaire 
information,  counts  of  activities,  computer  run  sheets,  personnel  hourly 
activity  description,  minutes  of  meetings,  and  written  project  reports. 
The  cut-off  date  for  data  was  August  31,  1978,  except  for  resource 
data  which  was  discontinued  on  June  30,  1978.    Therefore,  the  most 
recent  activities  of  each  project  are  not  reflected  in  this  report. 
The  reader  should  be  aware  that  this  report  does  not  attempt  to 
describe  the  entire  data  base  of  each  project;  the  activities  and 
data  described  are  meant  to  be  representative  of  the  operations  of 
each  demonstration  project. 
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PREFACE 

The  Bronx  Professional  Standards  Review  Organization  (BPSRO)  was 
awarded  a  two-year  contract  by  the  Health  Standards  and  Quality  Bureau 
(HSQB)  to  conduct  an  ambulatory  care  review  demonstration  project  (October 
1976  to  October  1978)  with  the  primary  purpose  of  developing  an  effective 
identifier  of  problems  in  ambulatory  care  by  examining  hospital  readmission 
data.    Subsequent  to  this  initial  award  BPSRO  has  been  funded  to  continue 
ambulatory  review  activities  through  September  1979.    The  initial  demon- 
stration effort  included  two  major  tasks: 

1.  To  study  a  four-year  retrospective  sample  of  hospital  and 
ambulatory  records  of  patients  rehospital ized  for  selected 
diagnostic  conditions,  in  order  to  assess  the  potential 
relationships  between  episodes  of  rehospital izati on  and 
ambulatory  care. 

2.  To  compare  a  matched  group  of  single  admission  patients  with 
the  readmission  group  to  determine  relative  differences  in 
ambulatory  care. 

A  modified  disease  severity  classification,  or  staging  technique, 
was  applied  to  both  the  single  and  multiple  admission  cases  at  admission 
and  discharge  to  aid  in  the  comparative  study.    It  was  assumed  that 
patients  who  had  not  been  hospitalized  repeatedly  over  the  study  period 
would  show  fewer  failures  in  meeting  criteria  and  might  demonstrate  less 
severe  levels  of  disease  classification.    This  assumption  was  based  on 
previous  work  done  with  the  application  of  disease  severity  classification 
in  connection  with  hospital  episodes. 
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The  demonstration  aimed  to  link  the  hospital  episodes  which  were 
equated  with  outcome  measures  to  ambulatory  care  rendered  prior  to  the 
hospitalization.    Ultimately  the  approach  sought  to  determine  the  useful- 
ness of  readmission  screening  as  a  means  of  identifying  providers  and 
patients  in  need  of  in-depth  review  as  well  as  to  demonstrate  the  effect 
on  hospital  admissions  of  appropriate  ambulatory  care  prior  to  and 
between  hospitalizations. 

The  cooperation  of  six  hospitals  within  the  PSRO  area  was  obtained 
after  screening  for  the  data  capability,  ownership  and  size  necessary 
for  the  project  (see  Table  1).    Readmission  rates  were  then  estimated  by 
generating  lists  of  all  readmissions  during  a  four-year  period,  using 
study  year  September  1,  1975  to  August  31,  1976  as  the  base  year  for 
listing  admissions.    Following  topic  selection,  disease  specific  readmis- 
sion cases  were  listed.    Physician  cooperation  was  obtained  after  a 
specified  number  of  readmission  cases  per  physician  had  been  identified 
at  the  participating  hospitals. 

PROJECT  ADMINISTRATION 

The  Bronx  PSRO  Board  of  Directors  provided  general  consent  to  the 
performance  of  the  demonstration  project.    An  Advisory  Committee  was 
formed,  consisting  of  administrators  and  medical  directors  from  all 
institutions  participating  in  the  program  and  assisted  in  soliciting 
participation  from  hospitals,  gaining  access  to  data  systems,  and  pro- 
viding direction  and  coordination  to  physician  committees  and  staff  to 
insure  the  achievement  of  BPSRO  and  HSQB  objectives.    The  organizational 
structure  of  the  demonstration  project  is  illustrated  in  Figure  1.   The  Advi- 
sory Committee  also  identified  review  topics,  assisted  in  assuring  support 
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TABLE  1 

BRONX  PSRO  BASELINE  HOSPITAL  DATA 


No.  Out-         Automated  Staging     Reason  for  Accep- 
Hospital  Type         patient  Visits  Potential  tance  in  Study 


Bronx  Memorial 

Municipal 
Teaching 

359,864 

Yes  -  HUP 

Large  OPD,  municv 
pal  setting 

Misericordia 

Vol untary 
Teaching 

36,668 

Yes  -  PAS 

Automated  system 

Montefiore 

Voluntary 
Teaching 

161,047 

Yes  -  own 
system 

Automated  system 

Parkchester 

Proprietary 

No  OPD 

No 

Manual  system 

Prospect 

Proprietary 

No  OPD 

Yes  -  PAS 

Automated  system 

Union 

Voluntary 
Community 

No  OPD 

No 

Manual  system, 
MD  access 
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FIGURE  1 
BRONX  PSRO  ORGANIZATION 
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from  administrative  and  medical  staff  at  participating  hospitals,  and 
assisted  the  BPSRO  staff  with  regard  to  project  related  questions. 

Physician  study  panels  consisting  of  3  to  4  specialists  were  con- 
vened for  each  of  the  study  topics  chosen.    These  panels  worked  in 
conjunction  with  the  study  Director  and  their  responsibilities  included 
developing  and  approving  the  review  procedures,  criteria  development, 
review  of  data  displays,  and  assisting  in  interpreting  and  identifying 
technical  problem  areas  as  the  review  effort  was  implemented. 

Bronx  PSRO  project  staff  included  the  Project  Director  (the  Bronx 
PSRO  Executive  Director),  the  Assistant  Project  Director,  the  Study 
Coordinator,  four  nurse  abstractors,  two  temporary  interviewers,  two 
temporary  coders,  and  one  half  time  secretary.    The  staff  from  Albert 
Einstein  College  of  Medicine  (AECOM),  the  primary  project  subcontractor, 
was  headed  by  the  physician  director  of  the  Department  of  Community 
Medicine  Evaluation  Unit  and  included  a  statistician,  a  secretary  and 
a  coder. 

AECOM  undertook  a  subcontract  to  perform  a  variety  of  technical 
activities  for  the  two-year  demonstration  project.    The  scope  of  work 
included  selection  of  topics  and  sites  in  conjunction  with  the  Project 
Advisory  Committee,  development  of  criteria  and  abstracting  forms, 
supervision  of  abstracting,  designing  and  performing  data  analysis,  and 
preparing  recommendations  on  study  findings  for  Bronx  PSRO.    The  AECOM 
Study  Director  was  responsible  for  the  technical  direction  and  analysis 
of  study  material  and  for  project  design  and  revision. 

Montefiore  Hospital,  a  large  voluntary  teaching  facility  which  was 
one  of  the  participating  sites  for  ambulatory  review,  had  a  subcontract 
to  perform  data  processing.    This  arrangement  was  made  mainly  because  of 
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its  accessible  data  processing  operations  and  its  experience  with 
medical  data  processing  and  analysis. 

Financial  accountability  for  the  demonstration  project  has  been 
the  responsibility  of  the  Bronx  PSRO  Assistant  Director  of  Finance. 
His  responsibilities  included  overseeing  expenditures  fo  study  personnel 
and  subcontractors,  projecting  future  expenditures  and  budget  manage- 
ment, in  conjunction  with  the  study  coordinator.    Bronx  PSRO  reported 
personnel  resource  expenditures  on  a  regular  basis  to  the  demonstration 
program  analysis  contractor. 

TECHNICAL  COMPONENTS 

A.     Selection  of  Topics  for  Review 

In  order  to  describe  the  data  flow  process,  HCMS  developed  an 
overall  data  flow  to  the  point  of  data  analysis  (Figure  2,  Data  Flow). 
The  initial  task  in  the  topic  selection  process  was  the  development  of 
a  list  of  readmission  cases  from  the  study  hospitals.    This  process 
involved  the  following  steps: 

1.  Generating  a  discharge  list  for  study  year  September  1,  1975 
to  August  31,  1976. 

2.  Tracing  back  each  case  to  determine  whether  there  were  addi- 
tional admissions  during  the  preceding  four-year  period 
(thus  identifying  a  case  as  a  readmission). 

In  order  to  select  topics  for  review,  cases  were  recalled  from  automated 
systems  via  a  unit  numbering  system,  or  pulling  and  reviewing  patient 
charts  from  a  manual  data  system.    The  project  staff  then  collected  data 
on  the  ten  most  frequent  discharge  diagnoses  for  the  study  hospitals. 
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Using  this  information,  four  conditions  were  selected  for  review  after 
discussion  with  the  Project  Advisory  Committee.    The  topics  chosen  were 
diabetes,  hypertension,  congestive  heart  failure,  and  pediatric  asthma. 
Factors  in  the  selection  included: 

1.  Expectation  that  appropriate  ambulatory  care  can  reduce  the 
frequency  of  hospitalization  or  have  an  impact  on  the  course 
of  disease 

2.  High  prevalence 

3.  Availability  of  established  staging  criteria 

4.  Representation  of  different  age  groups 

After  some  preliminary  review  of  data  sources,  three  of  the  topics, 
including  diabetes,  hypertension  and  congestive  heart  failure  were 
condensed  into  one  broad  topic  area  for  data  collection  and  analysis. 
This  group  was  broadly  termed  cardiovascular  cases,  since  it  also 
included  cases  with  concomitant  cardiovascular  conditions  (arterio- 
sclerotic heart  disease,  coronary  artery  disease,  myocardial  infarction, 
etc. ) . 

Disease  specific  readmission  cases  were  then  selected  for  each 
topic  using  the  initial  readmission  case  list.    Formats  were  also 
developed  for  screening  hospital  records  for  inclusion  or  exclusion  in 
the  study.    The  key  screening  criteria  were  verification  of  the  diagnosis, 
admission  justification  and  identified  sources  of  ambulatory  care.  The 
case  selection  process  is  summarized  on  page  1  of  the  Bronx  Data  Flow 
Chart  (Figure  2). 

After  identifying  references  to  ambulatory  care  providers  in  the 
hospital  record,  efforts  were  made  to  contact  the  providers  and  obtain 
their  cooperation.    Most  voluntary  review  demonstration  projects  solicit 
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physician  volunteers  prior  to  data  collection,  however,  this  study  of 
readmissions  required  a  substantial  amount  of  hospital  data  collection 
prior  to  requesting  participation  from  physician  volunteers  who  were 
identified  as  treating  readmitted  patients.    As  a  result  of  this  method 
of  identifying  physician  participants,  the  exclusion  rate  was  somewhat 
high. 

A  total  of  103  physicians  was  ultimately  reviewed  for  both  ambulatory 
and  hospital  care;  91  for  adult  (cardiovascular)  cases  and  12  for  pediatric 
(asthma)  cases.    Of  the  potential  physician  participants  in  the  BPSRO 
demonstration,  65%  were  excluded  for  a  number  of  reasons  related  to 
ambulatory  care  accessibility  (e.g.,  the  physician  could  not  be  located, 
had  no  ambulatory  practice,  had  moved,  had  not  cared  for  the  patient, 
etc.).    Some  physicians  in  the  hospital  sector  who  agreed  to  participate 
and  for  whom  hospital  records  were  abstracted,  were  found  not  to  have 
treated  the  patient  in  the  ambulatory  sector  or  the  physician  was  unable 
to  locate  the  ambulatory  records  at  the  time  of  office  abstracting.  These 
cases  were  therefore  excluded  from  the  sample.    Thirty-three  percent  of 
eligible  physicians,  for  whom  records  were  accessible,  refused  to  volunteer 
for  the  program  and  were  excluded  after  their  hospital  records  were 
abstracted,  with  67%  providing  office  records  for  review. 

Key  members  of  the  Bronx  PSRO  Board  and  Project  Advisory  Committee 
developed  protocols  for  soliciting  cooperation  of  physicians  in  partici- 
pating hospitals.    Physician  and  other  staff  representatives  were  identi- 
fied at  each  hospital  to  assist  in  obtaining  physician  cooperation. 
Also,  the  PSRO  Board  President  played  an  active  role  in  soliciting 
cooperation  among  staff  physicians. 
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One  hospital  had  87%  agreement  to  participate.    At  other  hospital 
sites  responses  were  variable,  depending  both  on  the  approach  used  and 
the  relative  influence  of  the  liaison.    Some  of  the  key  problems  encoun- 
tered in  obtaining  physician  cooperation  were  their: 

1.  Unfami 1 iarity  with  cases  attributed  to  physicians  who 
were  asked  to  participate. 

2.  Lack  of  contact  with  the  outside  of  the  hospital. 

3.  Fear  of  conflicts  with  respect  to  malpractice  coverage 
and  patient  rights. 

4.  Unwillingness  to  participate  unless  mandatory. 

5.  Fear  that  too  much  time  would  be  required  to  spend  with 
the  abstractor. 

6.  Desire  to  dictate  or  supervise  abstracting  process. 

Physicians  were  asked  to  allow  an  abstractor  ±o  visit  their  office 
for  record  abstracting  or  to  volunteer  to  bring  their  ambulatory  records 
to  the  hospital  for  abstracting.    The  latter  approach  was  found  not  to 
be  acceptable  by  the  majority  of  physicians. 

The  final  sample  of  readmission  cases  with  both  hospital  and  ambu- 
latory data  contained  469  cases.    These  represented  about  35%  of  the 
total  cases  initially  identified  and  abstracted.    The  control  sample 
of  single  admission  cases,  identified  from  discharge  data  for  the 
base  study  year,  included  69  adult  cases  and  30  pediatric  cases  for 
a  total  of  99.    These  control  cases  were  matched  by  demographic 
characteristics  and  disease  stage. 
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B.      Criteria  Development 

A  number  of  inputs  were  used  in  the  development  of  review  criteria. 
Medical  care  evaluation  criteria  that  the  AECOM  evaluation  unit  had 
gathered  from  various  ambulatory  review  programs  were  categorized  and 
reviewed  for  potential  use.    They  were  presented  to  the  physician  panels, 
who  assisted  in  identifying  criteria  for  the  specific  review  topics  and 
reviewed  existing  criteria  to  incorporate  into  the  criteria  sets  used 
in  the  demonstration. 

The  final  criteria  lists  were  largely  sets  of  explicit  process 
items  along  with  disease  classification  criteria.    Each  topic  included 
a  set  of  initial  workup  criteria  for  gathering  baseline  ambulatory  and 
hospital  data.    In  addition,  an  extensive  list  of  items  for  abstracting 
hospital  and  ambulatory  visits  was  utilized.    The  criteria  required 
notation  not  only  of  presence  or  absence  of  process  items,  but  in  some 
cases  of  clinical  values,  prescription  dosages,  changes  in  medication 
and  patient  compliance  information. 

In  addition  to  the  hospital  and  ambulatory  audit  criteria  a  number 
of  screening  criteria  were  required  by  the  Bronx  PSRO  for  identifying 
data  sources  and  linking  hospital  and  ambulatory  information,  including: 

1.  Readmission  case  identification  criteria 

2.  Admission  justification  criteria  (Appendix  B) 

3.  Diagnosis  verification  criteria 

Staging  or  disease  classifications  were  developed  by  the  physician 
panels  in  conjunction  with  the  AECOM  study  director  and  are  described  by 
HCMS  in  Appendix  C.    In  addition,  sets  of  staging  criteria  developed  by 
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SysteMetrics  were  applied  by  automated  means  to  discharge  data  for 
the  study  index  year  for  Montefiore  Hospital.    Staging  results  for 
diabetic  and  hypertensive  cases  included  in  the  readmission  sample 
were  compared  with  the  modified  disease  classification  to  determine 
the  usefulness  of  automated  staging  in  classifying  severity  of  illness. 

Criteria  sets  went  through  a  number  of  modifications  throughout  the 
initial  data  collection  period.    The  physician  specialty  panels,  in  con- 
junction with  the  AECOM  Study  Director,  were  responsible  for  all  criteria 
modifications. 

A  readmission  case  was  defined  as  any  case  admitted  more  than  once 
for  the  same  or  a  related  condition  over  a  four-year  period.*  Admission 
was  justified  using  American  Medical  Association  and  PSRO  criteria, 
diagnosis  was  verified,  and  finally,  sources  of  ambulatory  care  were 
identified  prior  to  admitting  the  case  into  the  study. 

C.    Data  Collection  and  Processing 

A  variety  of  accessing  techniques  were  utilized  to  retrieve  and 
screen  the  hospital  readmission  cases.    In  hospitals  where  manual  systems 
were  used,  individual  patient  records  were  pulled  and  examined.  Where 
automated  systems  were  in  use,  abstract  service  reports  and  other  auto- 
mated sources  were  used  to  facilitate  the  process. 

Once  hospital  cases  were  identified  and  screened,  the  medical 
records  were  abstracted  at  each  facility.    Abstracting  forms  for  use  in 
both  ambulatory  and  hospital  abstracting  were  designed  by  the  AECOM 
staff  with  the  aid  of  the  physician  panels.    Two  types  of  abstract  forms 
were  used,  the  first  being  the  initial  workup  sheet  which  gathered 

*Bronx  PSRO  Ambulatory  Care  Review  Project:    Final  Plan,  March  25,  1977,  p.  10. 
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historical,  baseline  and  initial  treatment  plan  data  for  each  ambulatory 
chart  reviewed  and  each  index  hospital  admission.    The  second  form  used 
was  the  data  collection  flow  sheet  which  was  also  used  for  both  hospital 
and  ambulatory  visits.    In-hospital  data  collection  was  limited  to 
staging  the  hospital  episode,  confirming  the  diagnosis,  determining 
admission  justification,  obtaining  information  on  ambulatory  care  pro- 
viders, and  collecting  certain  key  process  items.    Ambulatory  data 
collection  entailed  gathering  all  information  relevant  to  the  diagnostic 
topic  as  well  as  information  related  to  disease  complications. 

The  process  of  ambulatory  data  collection  required  a  number  of 
administrative  steps.    First,  several  mechanisms  were  utilized  for  the 
identification  of  sources  of  ambulatory  care,  including  examination  of 
hospital  records,  use  of  master  lists  of  patients  in  facilities  with 
outpatient  services,  review  of  insurance  claim  files,  telephone  contacts 
with  patients,  etc.    Physicians  were  then  contacted  and  asked  to  partici- 
pate in  the  demonstration  project.    Those  who  agreed  to  participate  were 
thereafter  contacted  by  telephone  to  schedule  the  office  abstracting. 
Some  cases  patients  in  the  sample  were  found  to  have  more  than  one 
source  of  ambulatory  care,  requiring  abstracting  from  more  than  one  site. 
The  data  collection  process  is  illustrated  in  Figure  2:    Bronx  Data 
Flow,  page  2--Abstracting. 

The  data  was  collected  by  trained  abstractors  and  recorded  in 
longhand  and  with  the  use  of  numerical  and  alphabetical  codes.  The 
available  data  for  abstracting  ranged  from  charts  with  only  a  hospital 
summary  and  one  ambulatory  visit  to  voluminous  information  for  each 
visit  in  the  four-year  period.    Therefore,  a  detailed  coding  system  was 
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devised  which  served  to  reduce  copious  amounts  of  ambulatory  data  into 
annual  summaries  and  to  classify  patients  annually  by  medical  status. 
For  example,  coding  for  the  patient  data  card  involved  classifying 
all  patients  into  diagnostic  groups  on  the  basis  of  all  ambulatory 
and  hospital  data  for  the  entire  study  period.    In  addition,  an 
attempt  was  made  to  determine  and  code  numerically  an  overall  annual 
severity  level  of  illness.    This  information  was  deemed  pertinent 
to  the  provider's  performance  and  patient  compliance. 

Quality  control  measures  for  coding  consisted  of  spot  checking  of 
code  sheets  by  a  supervisor,  exchanging  and  reviewing  coded  cases  among 
coding  personnel  and  finally,  data  processing  edit.    No  formal  computa- 
tion of  coding  error  rates  was  undertaken  by  project  staff. 

After  coding,  four  general  types  of  data  were  entered  on  12  cards 
per  study  case  for  the  adult  cases  only,  including: 

1.  Patient  description  and  summary 

2.  Inpatient  data  for  each  admission  in  the  four-year  period 

3.  Initial  workup  data  for  historical  and  baseline  data 

4.  Annual  summary  of  ambulatory  care  data 

The  Montefiore  Hospital  Department  of  Biostatistics  undertook  a 
subcontract  to  design  the  data  base,  enter  the  data,  edit,  correct  and 
process  the  data  using  RAMIS,  a  standard  data  base  management  program. 
Data  processing  of  adult  cases  is  illustrated  on  page  3  of  the  Bronx 
Data  Flow  Chart  (Figure  2). 

Pediatric  study  cases,  which  numbered  less  than  100,  were  manually 
tabulated  by  the  PSRO  staff  using  McBee  cards  (see  Bronx  Data  Flow, 
Figure  2,  page  4:    Data  Processing—Pediatrics) . 
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D.  Data  Analysis,  Review  and  Decision  Making 

The  eight  data  files  which  comprise  the  data  base  for  the  adult 
study  contain  a  total  of  379  data  elements.    Presented  later  in  this 
report  is  a  discussion  of  these  data  elements.    Preliminary  analysis 
of  marginal  frequency  data  (see  Appendix  D)  has  been  initiated  at  Bronx 
PSRO,  however,  the  exact  types  of  analysis  to  be  used  to  determine  the 
effectiveness  of  monitoring  readmissions  as  a  means  of  identifying  ambu- 
latory care  issues  have  not  been  specified.    General  plans  for  data 
analysis  include  an  examination  of:    patient  characteristics;  correla- 
tions between  hospital  and  ambulatory  care;  the  relationship  of  initial 
workup  to  other  quality  indicators;  an  analysis  of  physician  response 
to  incidents.* 

Review  will  be  carried  out  by  the  physician  specialty  panels  who 
will  interpret  and  identify  problem  areas  to  forward  to  the  Advisory 
Committee  and  the  BPSRO  Medical  Education  Committee  to  develop  action 
plans. 

Although  review  and  feedback  have  not  been  implemented  at  the 
time  of  this  report  (10/78),  general  plans  for  these  components  have 
been  documented.    Specific  methods  are  not  delineated,  since  Bronx 
PSRO  has  long  maintained  that  such  procedures  should  depend  upon  study 
findings,  subsequent  to  thorough  data  analysis. 

E.  Intervention 

The  intervention  phase  proposes  to  encompass  physician  education, 
patient  education  and  recommendations  for  institutional  change.  Indirect 
educational  feedback  to  groups  of  physicians  by  hospital  affiliation  is 

♦Incidents  are  defined  as  changes  in  disease  classification  or  abnormal 
findings  or  symptoms. 
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planned  as  the  mode  of  intervention.    In  the  area  of  recommendations 
for  programs  in  patient  education  and  for  institutional  change,  the 
nature  of  the  recommendations  will  be  entirely  dependent  upon  the 
circumstances  requiring  corrective  action.    Due  to  the  voluntary 
nature  of  the  project,  the  Bronx  PSRO  felt  it  unwise  and  infeasible  to 
force  behavior  changes  via  an  individual  or  punitive  mode  of  corrective 
action. 

A  restudy  cycle  was  not  considered  feasible  for  the  BPSRO  demon- 
stration, given  the  four-year  study  interval  and  the  low  number  of 
potential  cases  which  could  be  identified  (based  on  the  initial  case 
selection  process  and  case  attrition  rate).    Thus,  behavior  change  based 
on  the  proposed  educational  feedback  will  not  be  measured  in  this 
study.    Rather,  the  findings  which  the  demonstration  aims  to  produce 
will  relate  primarily  to  two  research  questions: 

1.  Are  there  problems  in  ambulatory  care  of  readmitted  patients 
compared  with  single  admission  patients? 

2.  Are  there  problems  in  ambulatory  care  among  patients  admitted 
with  disease  stage  I,  II,  III,  or  IV  for  the  same  condition? 
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SECTION  III 
ANALYSIS  OF  DESIGN  AND  PLANNING 
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INTRODUCTION 

In  an  effort  to  identify  the  requirements  essential  for  developing 
a  Professional  Standards  Review  Organization  (PSRO)  ambulatory  care 
quality  assurance  capability,  Health  Care  Management  Systems,  Inc.  (HCMS) 
developed  and  administered  two  questionnaires  to  PSRO  ambulatory  care 
review  system  personnel  participating  in  the  demonstration  program.  The 
information  gained  from  the  questionnaires  is  intended  for  use  by  federal 
officials  and  PSRO  leadership  in  highlighting  design,  planning  and  opera- 
tion activities  that  must  be  accomplished  in  establishing  the  foundation 
for  a  successful  ambulatory  review  program. 

The  First  Year  Questionnaire:  Planning 

The  questionnaire  covered  four  major  planning  areas:    1)  development 
of  the  basic  conceptual  design  of  the  review  system,  2)  project  manage- 
ment (e.g.,  formation  and  responsibilities  of  the  project  management 
committee  and  project  staffing  requirements),  3)  demonstration  project 
relationships  with  other  PSRO  organizational  units  (the  PSRO  Board  and 
standing  committees),  and  4)  relationships  with  groups  and  organizations 
external  to  the  PSRO  (PSRO  members  and  providers  associated  with  the 
demonstration  project  as  volunteer  participants,  consultants,  and  the 
analysis  contractor).    The  methods  used  to  construct,  administer,  and 
analyze  the  questionnaire  are  reported  on  pages  8-12  of  Appendix  1, 
"Interim  Report  Cooperative  Demonstration  and  Analysis  of  Ambulatory 
Care  Quality  Assurance  Review  Methodology  in  PSRO  Settings."    Data  was 
analyzed  across  all  PSRO  projects  and  findings  reported  below  reflect 
the  opinion  of  aggregated  demonstrated  project  participants. 
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The  Second  Year  Questionnaire:    Design  and  Operations 

The  second  questionnaire  focused  more  specifically  on  the  actual 
success  of  each  site's  project  design  and  resultant  operation.  A 
substantial  number  of  items  were  aimed  at  management  and  administra- 
tion issues.    Other  items  questioned  resources  and  funding  and  methods 
for  topic  selection,  criteria  development,  data  collection  and  pro- 
cessing, review  and  decision  making,  and  intervention.    The  questionnaire 
was  divided  into  two  sections.    Whereas  the  first  year  questionnaire 
was  analyzed  across  all  PSRO  projects,  the  second  year  questionnaire 
was  analyzed  both  by  individual  project  (Section  I)  and  across  projects 
(Section  II).    The  findings  from  Section  I  are  reported  below;  the 
findings  from  Section  II  are  found  in  Volume  II  of  this  report. 

SYNOPSIS  OF  FIRST  YEAR  FINDINGS 

Twenty  requisites  and  five  additional  elements  for  a  planning 

process  were  extracted  from  interviews  with  25  ambulatory  care  quality 

review  system  planners  participating  in  five  demonstration  projects. 

Overall,  20  requisites  (numbered)  for  planning  were  identified  and 

five  elements  (E)  came  very  close  to  meeting  requisite  criteria. 

1.      Involve  the  PSRo  Board  in  the  review  of  progress  reports 
concerning  ambulatory  care  quality  assurance  system 
activities. 

El.      Prior  approval  of  ambulatory  care  quality  assurance 
objectives  by  the  PSRO  Board  is  essential  to  avoid 
committing  resources  to  activities  that  are  later 
abandoned. 

Two  respondents  said  that  PSRO  Board  approval  for  their  demonstra- 
tion projects  was  obtained  on  the  basis  of  little  information  on  Board 
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members'  part.    Since  original  approval  of  the  project,  according  to 
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ten  respondents,  the  Board  has  not  been  active  in  project  activities 
other  than  receiving  reports,  primarily  at  Board  meetings.  Health 
Standards  and  Quality  Bureau  (HSQB)  required  Board  approval  of  PSRO 
participation  in  the  demonstration  program.    The  one  PSRO  which  did  not 
continue  to  participate  in  the  program  did  not  obtain  prior  Board 
approval.    Two  respondents  from  this  project  emphasized  the  need  for 
Board  agreement  and  approval  of  project  objectives  before  the  initia- 
tion of  activities  in  order  to  avoid  wasting  resources. 

2.  Assure  that  all  participants  in  review  system  design  and 
operation  (PSRO  staff,  PSRO  consultants,  the  funding 
agency  and  the  analysis  contractor)  have  a  complete  and 
common  understanding  of  PSRO  ambulatory  care  quality 
assurance  system  goals,  objectives  and  philosophy. 

Eight  respondents  emphasized  the  need  for  all  review  system 
planners  (PSRO  professionals,  staff  and  consultants  to  the  PSRO)  to 
have  an  early  understanding  of  the  goals.    They  felt  this  might  keep 
activities  peripheral  to  the  goals  from  draining  resources  at  a  later 
date.    One  respondent  emphasized  the  need  to  put  the  goals  in  written 
form  to  serve  as  an  unambiguous  reminder  to  all  throughout  the  review 
system  planning  phase.    Another  thought  that  a  common  understanding  was 
particularly  important  when  the  personnel  from  more  than  one  organization 
are  involved  in  project  design  and  planning.    Respondents  also  emphasized 
the  need  for  a  common  understanding  between  project  participants,  the 
funding  agency  and  the  analysis  contractor. 

3.  Attract  a  core  individual  or  individuals  to  the  review 
system  to  assure  the  continuing  momentum  of  review 
system  design. 

Five  respondents  mentioned  the  necessity  of  involving  a  person 
or  persons  with  both  a  well -formulated  review  system  core  idea  and 
the  time  and  dedication  to  devote  to  nursing  that  concept  through 
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the  stages  of  review  system  planning.    Such  a  dedicated  leadership 
is  required  to  provide  continuity  and  assure  continuing  momentum, 
and  particularly  to  refine  the  conceptual  base  of  the  review  system 
as  project  planning  progresses.    These  critical  persons  are  required 
for  assembling  staff  resources  and  for  interaction  with  the  various 
physician  groups  during  the  review  system  planning  phase.    One  of  the 
respondents  said  that  as  planning  progresses  and  project  staff  other 
than  core  individuals  begin  to  understand  the  details  of  the  review 
system  concept,  the  dependence  of  project  planning  on  this  core  declines. 

4.  Attract  to  the  review  system  planning  team  a  medical 
leader  whose  opinion  is  valued  by  community  physicians. 

Four  respondents  emphasized  that  the  involvement  of  a  medical 
leader  whose  opinion  is  respected  by  community  physicians  and  by  all 
project  planners  was  important  to  the  planning  phase.    The  medical 
leader's  importance  lies  in  his  ability  to  coordinate  the  sometimes 
diverging  perspectives  of  the  various  project  planners.    One  person 
who  speaks  with  authority  is  required  to  resolve  potential  conflicts 
and  demonstrate  to  planners  the  wisdom  of  certain  resolutions. 

5.  Define  consultant  role  and  tasks  as  specifically  as 
possible  to  maximize  consultant  usefulness  to  review 
system  planning. 

Six  respondents  felt  that  consultants  outside  the  PSRO  could  offer 
significant  assistance  to  ambulatory  care  review  system  planners.  Two 
respondents  emphasized  the  need  for  the  PSRO  to  specifically  define  the 
consultant's  tasks  and  expectations  early  in  the  PSRO-consultant  relationship. 

Three  review  system  planners  provided  suggestions  on  how  to  enhance 
the  usefulness  of  the  analysis  contractor  in  his  role  as  technical  con- 
sultant during  the  planning  process.    While  these  respondents  felt  that 
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the  analysis  contractor  was  quite  helpful  in  identifying  areas  of  the 
project  that  required  clarification,  they  thought  that  the  contractor 
should  have  taken  a  more  active  role  in  helping  the  planners  to  resolve 
these  issues.    While  these  particular  respondents  did  not  specifically 
so  mention,  two  others  mentioned  the  need  to  clarify,  at  an  early  date, 
the  role  to  be  assumed  by  the  analysis  contractor,  especially  in  the 
area  of  technical  consultation. 

6.  Designate  one  review  system  planning  team  member  to 
coordinate  and  rewrite  planning  documents,  integrating 
sections  produced  by  various  other  system  designers. 

7.  Include  on  the  review  system  planning  staff  one  person 
at  the  full-time  or  nearly  full-time  level  responsible 
for  coordinating  the  technical  activities  for  daily 
review  system  planning. 

E2      It  is  useful  to  include  on  the  review  system  planning 

team  a  person  with  skills  in  system  design  and  knowledge- 
able in  the  daily  operation  of  review  system  activities. 

Six  respondents  saw  the  need  to  include  a  full -time  or  nearly  full- 
time  PSRO  staff  member  to  coordinate  planning  and  manage  eht  operation 
of  the  review  system;  also,  as  one  respondent  mentioned,  this  full- 
time  staff  member  is  needed  to  attend  to  the  time-consuming  tasks  and 
the  myriad  of  details  that  arise  in  such  an  enterprise.    Three  respondents 
emphasized  the  importance  of  this  person  having  skills  in  system  design 
and  management  of  day-to-day  activities. 

8.  Emphasize  to  review  system  planners  that  planning  activities 
are  evolutionary  and  that  they  can  expect  testing  and 
revision  to  continue  beyond  the  initial  drafting  of  a  system 
design. 

Seven  planners  mentioned  the  difficulty  of  producing  planning 
documents  that  anticipated  the  future  details  of  their  proposed  ambu- 
latory care  review  systems.    Five  respondents  mentioned  that  planning 
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activities  would  continue  beyond  the  planning  phase  and  into  the  opera- 
tional phase.    They  emphasized  that  it  is  impossible  during  the  plan- 
ning phase  to  anticipate  all  the  contingencies  that  might  develop  in 
the  operation  of  the  review  system.    One  respondent  said  that  concept 
development  is  evolutionary,  requiring  modification  as  difficulties 
arise.    Others  said  that  alternative  solutions  to  problems  that  are 
anticipated  during  planning  can  often  only  be  investigated  in  an  opera- 
tional environment.    Two  respondents  mentioned  that  while  the  general 
review  system  design  and  initial  steps  can  be  finalized  during  plan- 
ning, the  details  must  await  operational  activities.    One  respondent 
thought  review  system  design  might  entail  a  trial-and-error  process 
for  certain  problems. 

9.     Implement  selected  feasibility  tests  of  the  review 
system  components  to  enhance  planning  prior  to 
committing  resources  to  larger-scale  operational 
activities. 

Nine  respondents  said  that  a  feasibility  test  of  some  of  the 
uncertainties,  utilizing  fewer  records  than  the  operational  review 
system  would  later  involve,  would  have  been  helpful.    Commonly  suggested 
review  system  components  for  feasibility  tests  were:    1)  the  abstract 
form,  and  2)  a  determination  of  what  data  were  likely  to  be  found  in 
the  ambulatory  record  and  might  thus  be  included  for  quality  review. 
Four  of  the  nine  respondents  thought  that  a  limited  pilot  study  of 
the  entire  review  system  would  have  been  helpful,  although  several 
viewed  the  demonstration  project  itself  as  a  pilot  study.    The  other 
five  respondents  felt  that  since  a  limited  amount  of  time  was  provided 
for  the  demonstration  project,  a  pilot  study  of  the  entire  review 
system  was  not  possible;  that  the  preparation  required  for  such  a 
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test  was  as  extensive  as  was  required  for  operating  the  actual  demon- 
stration review  system  and  was,  therefore,  not  an  efficient  use  of 
project  resources. 

10.     Make  review  system  staff  aware  of  the  purpose  and  demands 
of  planning  in  order  that  these  demands  do  not  dampen 
their  enthusiasm. 

E3.     Specific  deadlines  for  review  system  planning  and  planning 
documents  tend  to  expedite  those  activities  within  busy 
PSROs. 

Two  respondents  commented  on  a  related  issue,  the  effect  that 
extended  planning  periods  had  on  project  staff.    These  respondents  felt 
that  staff  enthusiasm  for  the  demonstration  project  was  jeopardized 
at  times  by  an  inability  to  investigate,  in  an  operational  setting, 
what  everyone  perceived  were  uncertainties  concerning  project  design. 
One  of  these  respondents  as  well  as  a  third  thought  that  project  inter- 
action with  outside  monitoring  (HSQB  and  the  analysis  contractor) 
should  be  more  intensive  over  a  shorter  period  of  time  in  order  to 
produce  an  improved  planning  process  and  allow  earlier  testing  of  the 
review  system  design. 

Responses  varied  concerning  the  amount  of  time  allotted  to  writing 
planning  documents.    Four  respondents  felt  that  a  sufficient  amount  of 
time  was  available  for  the  production  of  the  concept  paper,  the  pre- 
liminary and  the  final  plans.    Six  felt  that  they  could  have  used 
more  time.    Three  respondents  mentioned  the  difficult  and  time-consuming 
tasks  of  integrating  the  concerns  of  everyone  participating  in  project 
planning  (staff,  consultants,  HSQB  and  the  analysis  contractor)  into 
one  coherent  planning  document.    Three  of  those  who  felt  that  sufficient 
time  was  available  for  writing  documents  (planners  who  were  not  directly 
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involved  in  the  writing)  thought  that  if  more  time  had  been  allotted, 
the  document  writing  would  have  consumed  that  time  without  producing 
plans  of  a  higher  quality  or  containing  any  more  detail;  these  respon- 
dents felt  that  deadlines  served  the  function  of  expediting  organizational 
activities. 

11.      Include  on  a  review  system  management  committee  representa- 
tives of  those  physicians  whose  ambulatory  care  will  be 
reviewed. 

E4      Inclusion  of  key  physicians  skeptical  of  ambulatory  care 
quality  assurance  in  management  activities  can  help 
assure  that  their  skepticism  does  not  become  opposition. 

Each  of  the  five  PSROs  participating  in  the  demonstration  project 
formed  a  management  committee  to  oversee  the  planning  and  operation 
of  their  review  systems.    Five  respondents  mentioned  the  importance  of 
including  on  that  committee  representatives  of  the  physicians  whose 
medical  care  would  be  reviewed  so  that  a  liaison  could  be  established 
between  the  review  system  and  the  individual  physicians.    The  liaison, 
a  physician,  would  convey  the  concerns  of  his  constituents  to  the 
PSRO,  guaranteeing  communication  between  the  physician  community  and 
the  ambulatory  review  system  managers.    Representatives  from  hospital 
staffs,  according  to  the  five  respondents,  can  serve  as  the  liaison 
between  the  PSRO  and  community  physicians  since  most  physicians  are 
associated  with  a  hospital.    Two  respondents  mentioned  that  their 
review  system  management  committee  included  a  physician  who  had  a 
skeptical  attitude  toward  the  review  of  ambulatory  care  and  who  was 
recruited  for  the  committee  to  assure  that  his  skepticism  did  not 
become  opposition. 
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12.     Indicate  to  planners  that  they  should  expect  that  PSRO 
members  will  express  little  desire  to  become  involved 
in  review  system  planning  activities. 

Seven  review  system  planners  said  that  although  the  PSRO  general 
membership  was  notified,  it  expressed  little  desire  to  participate  in 
planning  activities.    Several  respondents  were  surprised  that  the 
physician  community  did  not  express  more  negative  reactions  concerning 
ambulatory  review.    Only  one  respondent  stated  that  a  "couple"  of  PSRO 
physicians  responded  by  volunteering  for  project  committees.  Another 
respondent  elicited  little  reaction  from  physicians  even  after  his 
personal  explanations  of  the  project.    Five  respondents  explained  that 
notification  usually  occurred  through  the  PSRO  newsletter,  although 
in  two  projects  the  PSRO  annual  meeting  was  also  used  to  inform  the 
membership.    In  either  case  only  a  general  project  description  was 
provided. 

E5       Inclusions  of  the  PSRO  membership  in  the  design  and 
operation  of  the  ambulatory  care  quality  assurance 
system  should  await  its  testing  in  order  not  to  arouse 
premature  opposition. 

Nine  respondents  felt  that  it  was  premature  at  this  time  to  involve 
the  PSRO  general  membership  in  the  details  of  the  design  and  operation 
of  the  ambulatory  care  review  system.    These  planners  felt  that  the 
membership  should  not  be  involved  until  review  was  perfected  and  a  v/ell- 
developed  and  tested  system  could  be  presented  to  them.    Two  of  these 
planners  specifically  mentioned  the  danger  of  arousing  opposition  to 
ambulatory  review,  opposition  that  would  "muddy  the  waters"  for  the 
future  and  defeat  ambulatory  review  before  it  had  a  chance  to  develop. 

Sentiment  on  this  point  was  not  unanimous.    One  respondent  felt 
that  the  benefits  to  be  gained  by  increased  membership  interest  in 
the  PSRO  and  the  ambulatory  project  were  worth  risking  the  potential 
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opposition  that  might  occur  through  such  involvement.    Another  felt 
that  should  disharmony  develop,  project  planning  should  include  the 
"loyal  opposition."    Another  respondent  from  the  same  project  felt 
that  as  many  physician  groups  as  possible  should  participate  in  order 
to  legitimize  the  project  within  the  medical  community. 

13.  Recruit  from  the  review  system  and  employ  as  representa- 
tives to  the  physician  community  those  physicians  with 
strong  personal  ties  to  the  groups  of  physicians  whose 
ambulatory  care  will  be  reviewed. 

14.  Identify  local  medical  community  opinion  molders  and 
enlist  them  as  personal  ambassadors  from  the  PSRO. 

Thirteen  respondents  emphasized  that  a  critical  factor  in  gain- 
ing physician  participation  in  the  demonstration  project  was  a  personal 
relationship  between  a  physician  representing  the  review  system  and 
the  physicians  whose  ambulatory  care  was  to  be  reviewed.    In  all  the 
projects  this  personal  relationship  was  one  that  had  developed  prior 
to  the  demonstration  project.    It  was  employed  in  obtaining  physician 
volunteers  for  the  project  through  letters,  telephone  calls  and  actual 
personal  contracts.    In  the  two  projects  associated  with  hospitals 
representatives  of  medical  staffs  were  used  to  encourage  physician 
participation  in  the  demonstration  project.    Members  of  committees  in 
one  project  were  selected  in  large  measure  on  the  basis  of  their 
potential  ability  to  gain  the  cooperation  of  physician  volunteers. 
One  respondent  said  that  had  physicians  been  asked  anonymously  to 
volunteer  to  have  their  ambulatory  care  reviewed  they  would  have 
refused.    The  "peer  pressure"  implied  by  personal  contact  with  a  PSRO 
physician  representative  generated  the  cooperation.    Two  other  respon- 
dents mentioned  that  securing  the  cooperation  of  physicians  in  their 
areas  required  repeated  personal  contact  with  the  potential  volunteers. 
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One  project,  in  an  effort  to  obtain  the  participation  of  one  physician 
in  a  small  group  practice,  actually  obtained  the  participation  of  all 
members  of  that  group  through  contact  with  the  one  group  member.  Five 
respondents  saw  the  need  for  PSROs  to  identify  the  opinion  molders  in 
each  locality  who  would  serve  as  personal  ambassadors  from  the  PSRO  to 
the  physician  and  generate  support  for  ambulatory  care  quality  assurance 
activities.    Permission  to  review  the  ambulatory  care  of  physicians 
practicing  in  the  outpatient  department  of  a  project  hospital  was  secured 
through  the  hospital  administration,  and  each  individual  physician  did 
not  need  to  be  recruited. 

15.  Emphasize  to  the  participating  physician  community  that 
the  review  system  will  provide  the  physician  with  informa- 
tion useful  to  his  practice. 

Five  respondents  felt  that  one  of  the  best  methods  of  eliciting 
cooperation  from  volunteer  physicians  whose  care  will  be  reviewed  is 
to  agree  to  provide  the  physicians  with  feedback  of  review  results. 
One  respondent  said  that  volunteers  feel  that  review  may  be  used  to 
gain  some  knowledge  about  their  practices  without  any  expense  on  their 
part.    Another  felt  that  it  was  important  to  provide  feedback  as  quickly 
as  possible.    The  importance  of  providing  positive  as  well  as  negative 
feedback  to  the  physician  was  also  emphasized.    Some  physician  volunteers, 
according  to  one  respondent,  made  the  provision  of  feedback  a  condition 
for  their  participation. 

16.  Emphasize  to  those  physicians  whose  ambulatory  care  will 
be  reviewed  by  the  quality  assurance  system  that  their 
early  and  willing  cooperation  will  avoid  the  imposition 
of  a  system  from  outside  the  local  medical  community. 
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Fourteen  respondents  felt  that  an  important  factor  in  attracting 
volunteers  to  ambulatory  review  activities  was  the  desire  of  the  physi- 
cians themselves  to  become  involved  in  a  physician-led  effort  to  estab- 
lish ambulatory  care  quality  assurance  systems,  thus  avoiding  nonphysician 
design  of  systems  that  may  possibly  have  antithetical  consequences  for 
them.    Two  respondents  specifically  mentioned  physicians'  concern  with 
the  imposition  of  an  unworkable  system  by  the  federal  government,  one 
not  attumed  to  local  needs.    Two  other  respondents  said  that  the  PSRO 
emphasized  to  potential  volunteers  the  opportunity  to  influence,  through 
the  demonstration  project,  the  evolving  federal  policy  toward  ambulatory 
care  quality  assurance.    One  of  these  respondents  informed  volunteers 
of  previous  PSRO  experiences  in  influencing  policy. 

17.     Prepare  system  planners  to  expect  that  physicians  whose 
care  is  being  reviewed  require  few  details  concerning 
the  technical  operation  of  the  review  system  during  the 
planning  phase. 

Seven  respondents  mentioned  that  the  physician  volunteers  requested 
general,  not  detailed,  information  concerning  the  proposed  review  system. 
This  information  was  supplied  to  them  in  both  written  and  verbal  form. 
Two  respondents  from  different  projects  mentioned  that  a  personal  con- 
tact session  of  only  10  or  15  minutes  was  necessary  to  explain  project 
objectives  and  procedures,  and  few  volunteers  requested  additional 
detail.    One  respondent  mentioned  that  volunteers  were  more  concerned 
with  the  degree  to  which  review  system  activities  would  affect  them 
than  with  the  system's  technical  details.    Another  respondent  said 
that  volunteers  were  concerned  about  what  the  review  system  would  cost 
them.    Volunteers  were  interested  in  what  criteria  would  be  used  in 
evaluating  their  ambulatory  care.    A  respondent  from  a  project  associated 
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with  PSRO  area  hospitals  confirmed  that  the  hospitals  were  also  inter- 
ested in  a  general,  and  not  a  detailed,  description  of  the  proposed 
review  system. 

18.  Prepare  system  planners  to  expect  that  physician  volun- 
teers whose  ambulatory  care  is  being  reviewed  will  express 
little  interest  in  participating  in  the  design  or  the 
technical  activities  of  operating  the  review  system. 

Six  respondents  said  that  the  physician  volunteers  were  not  inter- 
ested in  participating  in  the  design  or  operation  of  the  ambulatory 
care  review  system.    Five  of  these  said  that  none  of  the  volunteers 
expressed  any  desire  to  become  involved.    The  sixth  respondent  said 
that  a  few  did  express  a  desire,  while  other  physician  volunteers 
offered  suggestions.    The  majority  of  volunteers,  however,  were  not 
interested  in  the  technical  details  of  the  review  system.    One  respon- 
dent felt  that  the  physicians  were  comfortable  in  delegating  this 
responsibility  to  their  project  representative.    Another  felt  that  they 
simply  did  not  have  the  time  for  such  activities  and  that  some  mechanism 
should  be  created  to  allow  them  the  level  of  involvement  that  their 
time  permits. 

19.  Assure  that  review  system  activities  do  not  interfere  with 
the  physician's  office  routine. 

Five  respondents  mentioned  that  physician  volunteers  concerned 
that  review  system  activities  might  interfere  with  office  routine. 
One  potential  volunteer  decided  not  to  participate  in  the  demonstra- 
tion project  because  of  what  he  saw  as  potential  disruption  to  his 
practice.    Two  respondents  said  that  this  project  goal  was  to  demon- 
strate that  effective  quality  assurance  systems  can  be  developed  and 
operated  without  interfering  with  office  routine. 
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20.     Assure  the  confidentiality  of  all  physician  and  patient 
information. 

Nine  respondents  mentioned  that  physician  volunteers  were  con- 
cerned that  the  medical  record  data  remain  confidential.    They  were 
apprehensive  about  the  potential  dangers  involved  in  breaching  patient 
privacy  by  releasing  information.    Another  concern  was  whether  the 
physician  maintained  legal  custody  of  the  medical  information  and 
could  release  it  for  quality  review  activities  without  risking  any 
patient-initiated  legal  consequences.    One  respondent  said  that  volun- 
teers were  most  concerned  about  the  identification  of  the  physician. 
Another  mentioned  that  the  PSRO  anticipated  the  problem  and  had  assured 
confidentiality  of  all  data  in  the  initial  PSRO  letter  inviting  physi- 
cians to  participate  in  the  project.    Still  another  stated  that  this 
potential  problem  was  mitigated  by  PSRO  confidentiality  policies.  Two 
physician  respondents  felt  that  the  confidentiality  issue  was  not  the 
real  issue  but  was  being  used  by  some  as  an  excuse  for  not  participating 
in  quality  assurance  activities. 
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SECOND  YEAR  FINDINGS 
Method 

Subjects  and  Questionnaire  Development 

The  subjects  for  the  survey  were  87  persons  who  were  involved  in 
various  aspects  of  the  demonstration  projects  in  the  five  sites.  For 
analysis  purposes,  subjects  were  classified  according  to  their  role  in 
the  demonstration  project  (e.g.,  PSRO  staff  or  physician,  physician  or 
nonphysician  consultant,  abstractor  and  other).    Also,  they  were  classified 
according  to  their  level  and  type  of  involvement  in  the  project. 

The  questionnaire  was  composed  of  two  sections.    The  first  section 
had  18  objective  items  where  the  respondent  was  requested  to  circle  one 
of  three  answer  choices  which  best  described  their  position  and  then 
indicate  the  strength  of  their  position  along  the  continuum  from  strongly 
agree  to  strongly  disagree.    If  respondents  felt  s-trongly  about  a  question, 
they  had  the  option  of  answering  more  than  one  choice. 

The  second  section  is  comprised  of  a  mixture  of  22  open  and  closed 
questions.    The  bulk  of  these  questions  focus  on  describing  the  PSRO 
demonstration  experience  to  provide  technical  assistance  to  new  PSROs 
beginning  ambulatory  care  review  programs. 

The  questionnaire  development  began  with  staff  review  of  over  150 
articles,  books,  and  papers  on  the  topic  of  quality  assurance.  Each 
reference  was  read  to  extract  relevant  information  on  ambulatory  care 
quality  assurance.    A  listing  of  strengths  and  weaknesses  in  conducting 
ambulatory  quality  assurance  was  comprised.    Special  problems  in  the 
evaluation  of  ambulatory  care  were  also  noted  within  the  literature. 
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HCMS '  previous  experience  with  ambulatory  care  quality  assurance 
projects  was  then  used  to  build  a  model  for  reviewing  care  rendered  in 
the  office  setting.    The  model  was  comprised  of  three  cycles:  screening, 
action,  and  restudy.    The  components  of  the  model  consisted  of  such 
factors  as  selection  of  topics  or  providers,  criteria  development, 
review  and  decision  making,  and  impact  assessment. 

From  this  model  HCMS  staff  developed  a  list  of  issues  being  investi- 
gated within  each  site.    These  issue  lists  were  site  specific  but  gave  a 
picture  of  the  issues  and  problem  areas  facing  each  of  the  demonstration 
sites.    From  the  issue  lists  a  common  thread  of  issues  across  all  sites 
was  determined.    HCMS  and  HSQB  staff  discussions  were  also  held  to 
review  the  entire  ambulatory  care  demonstration  evaluation  effort.  Such 
discussions  when  combined  with  the  issue  lists  and  model  tended  to  focus 
survey  attention  on  the  future  of  ambulatory  care  rather  than  objectively 
determining  what  each  site  did  or  didn't  do  and  why. 

From  this  process  a  list  of  76  questions  were  developed.  These 
questions  were  all  open  ended.    In  order  to  better  quantify  some  of  them 
and  eliminate  others,  a  sample  of  32  questions  was  discussed  face  to 
face  with  a  group  of  people  working  on  the  demonstration  at  one  of  the 
sites.    HCMS  staff  reviewed  the  interpretations  given  to  the  questions 
as  well  as  the  responses.    The  interpretations  and  points  of  uncertainty 
displayed  by  PSRO  personnel  were  then  utilized  by  HCMS  staff  to  revise 
the  list  of  questions  and  convert  others  to  objective  (closed  ended) 
questions.    This  process  also  assisted  in  determining  relevance  of 
questions  as  well. 
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A  draft  of  the  survey  was  prepared  in  late  August,  1978.    The  HCMS 
staff  critically  reviewed  the  questions  and  a  final  draft  was  prepared 
on  September  1,  1978.    A  letter  soliciting  cooperation  support  from  Dr. 
Michael  Goran  of  HSQB  and  a  personal  letter  with  directions  for  survey 
dissemination  were  mailed  to  each  of  the  Executive  Directors  within  each 
site.    Each  Executive  Director  was  then  requested  to  disseminate  the 
survey  together  with  a  self-addressed  stamped  folder  to  each  of  the  key 
people  involved  in  the  project.    The  list  of  people  were  derived  after 
HCMS  reviewed  cost  log  voucher  data  from  each  site  and  confirmed  each 
list  of  names  with  each  Executive  Director. 

Complete  packages  of  surveys  and  return  envelopes  were  mailed  to 
each  Executive  Director  in  the  second  week  of  September.    A  two-week 
turn  around  was  requested  in  the  letter  which  accompanied  each  of  the 
surveys. 

A  series  of  follow-up  calls  from  HCMS  were  required  to  obtain 
responses  from  each  of  the  sites.    After  seven  weeks,  data  analysis 
began  and  no  more  questionnaires  were  accepted. 

The  final  response  rate  was  44  or  51%.    The  majority  of  those 
nonrespondents  were  physicians  who  served  as  consultants  to  the  project 
in  its  beginning  stages. 

Data  Analysis 

For  each  individual  project,  responses  in  Section  I  of  the  question- 
naire were  tallied  on  a  three-point  scale;  choices  1  and  2  (agree)  and 
4  and  5  (disagree)  were  collapsed.    Since  several  items  were  mutually 
exclusive,  if  a  respondent  had  conflicting  responses  indicating  he  did 
not  understand  the  item,  these  responses  were  eliminated  from  the  data 
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base.    From  a  total  response  rate  of  1,274  the  usable  responses  totaled 
1,203.    For  each  item,  the  response  rate  for  agree,  undecided,  and 
disagree  is  reported. 

Additional  analysis  examined  differences  between  physician  and 
nonphysician  responses  for  those  items  where  there  was  at  least  two 
responses  in  both  the  agree  and  disagree  categories.    The  analysis 
included  only  those  individuals  who  were  classified  as  either  a  PSRO 
staff  physician  or  physician  consultant  and  a  PSRO  staff  nonphysician, 
nonphysician  consultant  or  subcontractor  consultant.    Also  included 
were  only  those  individuals  who  were  rated  as  being  involved  in  all 
or  at  least  four  phases  of  demonstration  development. 

Analysis  of  Section  II  of  the  questionnaire  included  reading  the 
open-ended  responses  and  synthesizing  meaning  into  appropriate  cate- 
gories, depending  on  the  nature  of  the  question.    The  close-ended 
questions  in  Section  II  were  tallied  with  no  changes  in  the  response 
categories. 
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Discussion  of  Survey  Findings  (Section  I) 

Presented  in  Table  2,  "Survey  Items  and  Responses:    Bronx  PSRO"  are 
the  18  questions  along  with  the  total  responses  per  questions.  Twenty- 
five  questionnaires  were  sent  to  the  Bronx  PSRO;  10  responses  were  received. 
The  total  responses  were  251  and  four  responses  were  not  usable,  leaving 
247  total  usable  responses. 

Respondents  unanimously  agreed  that  the  Bronx  PSRO  demonstration  project 
is  a  research  project  and  that  research  must  be  conducted  to  better  under- 
stand problems  before  an  operational  program  should  be  implemented  (items  1, 
2  and  5).    Respondents  agreed  that,  although  use  of  physician  volunteers 
for  review  may  bias  results  of  research,  use  of  physician  volunteers  is  a 
necessity  (item  3). 

In  regards  to  the  goal  of  an  ambulatory  care  review  system,  respondents 
unanimously  agreed  that  the  purpose  is  to  change  physician  practice  patterns 
and  to  improve  the  quality  of  care  rendered  as  well  as  to  help  contain 
health  care  costs.    All  agreed  it  is  not  possible  to  say  whether  such 
review  programs  can  be  made  cost  effective  and  that  cost  effectiveness  is 
important  if  the  PSRO  program  is  to  survive  (items  4,  9  and  11). 

Respondents  agreed  that  review  should  focus  on  those  topics  which  have 
the  greatest  potential  for  improving  the  patient's  health  and  according 
to  data  accessibility  and  frequency  of  occurance  (item  12).    It  was  agreed 
that  future  review  systems  must  begin  to  integrate  nonphysician  treatment 
(item  14).    Criteria  for  review  should  emphasize  both  over  and  underutiliza- 
tion  of  medical  services  (item  17).    Finally,  the  ultimate  goal  of  a  system 
is  to  develop  standards  and  criteria,  compare  practice  patterns  to  them  and 
then  encourage  compliance  where  variations  exist  (item  18). 
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The  feasibility  issue  was  raised  in  several  questions.    Bronx  PSRO 
respondents,  for  the  most  part,  feel  that  from  their  experience  it  seems 
quite  feasible  to  implement  quality  assurance  programs  for  ambulatory  care 
on  a  nationwide  basis  (items  8,  13  and  15).    There  is  strong  opinion  that 
the  best  approach  to  changing  physician  practice  patterns  is  not  known  and 
more  research  is  required  (item  10).    Concerning  staff  resources,  respondents 
were  split  on  whether  more  assistance  was  needed  from  outside  the  PSRO, 
however  believed  they  could  have  used  more  technical  assistance  (item  6). 

An  additional  analysis  was  conducted  on  those  questions  which  showed 
disagreement  among  respondents.    The  items  were  analyzed  where  either  two 
or  more  respondents  appeared  to  disagree  (e.g.,  at  least  two  or  more 
responses  in  the  "agree"  category  and  at  least  two  or  more  responses 
in  the  "disagree"  category).    Analysis  was  conducted  to  determine  whether 
disagreement  may  have  occurred  due  to  difference  of  opinion  between  phy- 
sicians and  nonphysicians  who  had  been  heavily  involved  in  the  entire 
project.    Respondents  substantially  disagreed  on  four  items  and  on  all 
four  items  there  were  distant  differences  between  the  physician  and 
nonphysician  opinion. 

In  item  5a/b  nonphysicians  agreed  that  review  system  concepts  should 
be  self-generated  rather  than  rely  on  research  findings  of  others; 
physicians  disagreed.    In  item  6a    nonphysicians  believe  that  assistance  from 
outside  the  PSRO  was  needed;  physicians  disagreed.    In  item  9a  nonphysi- 
cians believe  that  a  review  program  should  look  at  practice  patterns  which 
differ  significantly  from  practice  norms  for  each  area  and  physicians 
indicated  that  review  should  be  of  the  entire  mainstream  of  practice 
(item  9b).    Finally,  in  item  13c  nonphysicians  did  not  respond  and  physi- 
cians indicated  that  the  approach  the  project  had  been  using  for  conducting 
ambulatory  care  review  was  largely  unacceptable  to  physicians. 
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TABLE  2 

SURVEY  ITEMS  AND  RESPONSES:    BRONX  PSRO 


1.     a)     Our  demonstration  is  a  research  project  wherein  data  collection 
will  assist  in  performing  subsequent  ambulatory  care  studies. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

7  0  1 


b)  We  are  interested  only  in  the  development  of  an  operational 
ambulatory  care  review  system  for  improving  quality  of  care 
rendered  in  our  area. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  1  1 


c)     Our  demonstration  is  a  combination  of  research  design  and 
implementation  of  an  operational  review  system.    We  believe 
one  must  conduct  adequate  front  end  investigation  prior  to 
implementation. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

3  0  1 


a)  In  view  of  the  problems  in  measurement,  conducting  research  on 
ambulatory  care  is  unlikely  to  produce  meaningful  results. 

AND 

b)  The  prime  emphasis  of  any  PSRO  should  be  on  development  of  an 
operational  quality  assurance  project,  research  is  not  likely 
to  result  in  improved  patient  care  in  the  practice  settings. 

TOTAL  RESPONSES   


Agree  Undecided  Disagree 

1  1  4 


c)     A  PSRO  must  conduct  research  to  better  understand  the  problem 
before  an  operational  program  to  resolve  the  problem  can  be 
implemented. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

10  0  0 
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a)  In  our  ambulatory  demonstration  project,  the  use  of  volunteer 
subjects  has  been  invaluable.  No  study  of  ambulatory  quality 
assurance  could  be  completed  without  voluntary  participants. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  0  1 


b)     Using  physicians  who  volunteer  their  office  data  is  a  practical 
solution  to  a  practical  problem  (obtaining  practice  data  from 
a  physician's  office).    In  most  instances,  there  is  no  other 
choice. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

5  1  1 


c)     The  use  of  volunteers  introduces  a  bias  into  the  results  of 
any  study  which  limit  the  general izability  of  the  findings  to 
the  practices  studied  and  reduces  the  potential  for  using 
results  in  HSQB  policy  development. 

 TOTAL  RESPONSES  

Agree  Undecided  .Disagree 

4  2  0 


The  purpose  of  a  well  constructed  PSRO  ambulatory  care  review 
system  is: 

a)     To  improve  the  care  rendered  to  all  patients  in  its  area. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  0  0 


b)     Change  physician  practice  patterns  which,  in  turn,  would 
impact  upon  the  care  rendered  to  patients  in  the  area. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

7  0  0 


c)     To  improve  the  quality  of  care  rendered  to  patients  in  the 
office  setting  as  well  as  contain  health  care  costs. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

9  0  0 


47 


5.     a)     In  conducting  an  ambulatory  care  quality  assurance  demon- 
stration, reliance  on  the  research  findings  of  others  is  use- 
ful but  not  mandatory. 

AND 

b)     PSROs  beginning  ambulatory  projects  should  place  little  reliance 
on  the  work  of  others  in  establishing  a  review  program,  most  of 
our  concepts  were  self  generated  to  accommodate  the  unique 
characteristics  of  our  geographic  area. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  1  3 


c)     It  is  necessary  to  conduct  a  complete  literature  search  to 
review  the  findings  of  others  prior  to  starting  any  research 
or  demonstration  project. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

6  0  0 


6  .     a)     Our  staff  resources  were  such  that  little  or  no  technical 
assistance  from  outside  the  PSRO  was  needed. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

3  2  2 

b)     In  launching  an  ambulatory  care  demonstration  project  heavy 
emphasis  should  be  placed  upon  the  expertise  of  various  out- 
side consultants  for  the  first  two  years. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

1  1  1 


c)     The  technical  assistance  provided  through  HSQB  and  HCMS  served 
all  of  our  technical  assistance  needs  during  the  demonstration. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

0  1  5 


7.     a)     The  amount  of  seriously  substandard  ambulatory  care  cannot 

accurately  be  assessed  based  upon  our  demonstration  experience 
thus  far.     It  is  too  soon  to  tell. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

7  0  1 
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b)     Substandard  cara  in  the  ambulatory  sector  is  pervasive  and  can 
be  found  to  a  greater  or  lesser  degree  in  most  office  practices, 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

3  0  0 


c)     From  our  experience  thus  far  it  appears  that  the  degree  of 
substandard  ambulatory  care  is  fairly  low  reflecting  only  a 
small  percentage  of  physicians. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

1  2  0 


8.     a)     Many  illnesses  treated  in  the  ambulatory  sector  are  ill 
defined,  self-limiting  conditions  for  which  there  are  no 
clearly  accepted  therapeutic  regimes.    As  such,  review  of 
ambulatory  care  is  not  feasible. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

0  0  2 


b)     Quality  assurance  in  ambulatory  care  is  no  different  than  any 
other  form  of  care,  it  exists  in  finite  amounts  and  those 
amounts  can  be  measured  just  the  same  as  inpatient  care  can 
be. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

2  2  1 


c)     From  our  experience  as  an  ambulatory  demonstration  site,  it 
seems  quite  feasible  to  implement  quality  assurance  programs 
for  ambulatory  care  on  a  nationwide  basis. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

0  1  5 

a)     An  ambulatory  quality  assurance  program  should  look  at  just 
those  physician  practice  patterns  which  differ  significantly 
from  practice  norms  for  each  area. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  0  2 
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b)     An  ambulatory  quality  assurance  program  should  look  at  the 
entire  mainstream  of  care  and  seek  to  optimize  the  practices 


of  as  many  doctors  as  possible. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

2  1  0 


c)     At  this  time,  it  is  not  possible  to  say  whether  ambulatory 
quality  assurance  programs  can  be  made  cost  effective  enough 
to  review  the  entire  spectrum  of  ambulatory  care. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

8  0  0 


10.     a)     Changing  practice  behavior  is  best  achieved  by  direct  practice 
pattern  feedback  to  each  practitioner  being  reviewed. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

1  1  0 


b)     Feedback  comparing  individual  practices  to  a  norm  or  standard 
results  in  physician  defensi veness  and  resistance.    The  best 
way  to  change  practice  behavior  is  through  education  and 
general  feedback  to  groups  of  physicians  without  individual 
comparisons. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  1  1 


c)     The  best  approach  to  changing  physician  practice  patterns  for 
purposes  of  quality  assurance  is  not  known  at  present,  more 
research  on  this  issue  must  be  undertaken. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

9  0  0 


11.     a)     Cost  containment  and  quality  assurance  are  totally  mutually 
exclusive  and  cannot  be  dealt  with  simultaneously  in  ambu- 
latory quality  assurance  efforts. 

TOTAL  RESPONSES  


Agree  Undecided  Disagree 

0  0  2 
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b)     The  primary  purpose  of  a  PSRO  quality  assurance  project  is  to 
improve  patients  care  regardless  of  the  cost  implications. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

0  0  6 


c)     Ambulatory  quality  assurance  while  emphasizing  improved 
patient  outcomes  must  also  consider  cost  effectiveness  in 
patient  care  if  the  PSRO  program  is  to  survive. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

5  1  0 


12.    a)     Ambulatory  care  review  should  focus  on  those  topics  which  have 
the  greatest  potential  for  improving  the  patient's  health. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

5  0  0 


b)     Review  topics  in  ambulatory  care  must  be  chosen  according  to 
data  accessibility,  and  frequency  of  occurrence  in  the  primary 
setting. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

5  0  0 


c)     Review  topics  are  best  developed  by  focusing  on  specific 

practice  problems  determined  by  physician  members  of  PSRO  peer 
review  committees. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

3  2  0 


13.  a)  The  approach  we  have  used  to  conduct  ambulatory  quality 
assurance  will  be  acceptable  and  feasible  in  conducting 
review  for  all  physicians. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  0  1 
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b)     Our  demonstration  approach  is  quite  unique  and  unlikely  to  be 
duplicated  to  the  point  where  it  would  be  acceptable  to 
physicians  in  other  PSRO  areas. 

TOTAL  RESPONSES 


c) 


Agree  Undecided  Disagree 

0  1  3 

The  approach  we  used  in  conducting  ambulatory  quality  assur- 
ance has  been  largely  unacceptable  to  physicians. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

2  0  2 


14.    a)     The  integration  of  review  for  ambulatory  services  rendered  by 
nonphysicians  with  existing  PSRO  efforts  is  not  feasible  at 
this  time. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

0  0  2 


b)     As  the  trend  toward  holistic  patient  care  increases,  the 
necessity  of  reviewing  nonphysician  treatment  will  become 
necessary  sometime  in  the  future. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

6  1  0 


c)     Incorporating  the  work  done  by  nonphysician  practitioners  into 
the  peer  review  process  is  quite  feasible  and  could  be  under- 
taken immediately. 

TOTAL  RESPONSES 


Agree  Undecided  Disagree 

3  1  0 


15.    a)     The  procedures  for  ambulatory  quality  assurance  developed  in 
our  demonstration  are  transferrable  to  any  other  PSRO  without 
modification  or  special  arrangements. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

0  2  2 
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The  nature  of  our  demonstration  is  quite  unique  and  it  is 
unlikely  that  our  approach,  could  ever  be  duplicated  in  another 
PSRO. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

0  1  1 


Transferrence  of  our  ambulatory  quality  assurance  procedures 
to  other  PSROs  while  achievable  would  entail  much  effort  and 
very  probably  modification  of  arrangements  and  procedures. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

7  0  1 


Problems  uncovered  in  practices  with  respect  to  one  review 
topic  are  often  associated  with  problems  in  other  topics. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

6  2  1 


The  criteria  developed  for  each  review  topic  should  focus  upon 
over  and  underutilization  of  medical  services  simultaneously. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

8  2  0 


The  ultimate  goal  of  an  ambulatory  quality  assurance  review 
system  is  to  develop  standards  and  criteria,  compare  practice 
patterns  to  them  and  then  encourage  compliance  where  variations 
exist. 

 TOTAL  RESPONSES  

Agree  Undecided  Disagree 

8  2  0 
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SECTION  IV 
QUANTITATIVE  PROGRAM  DESCRIPTORS 
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METHOD 

Requests  for  quantitative  descriptions  tailored  to  fit  the  specific 
programs  of  each  of  the  five  projects  were  sent  out  in  August  1978. 
Requested  data  involved  population  and  activity  items  for  the  sites 
under  study  by  the  projects  including  such  items  as  the  number  of 
hospitals,  clinics,  physicians,  patients  and  patient  visits  at  these 
sites.    Tabulations  were  requested  of  physicians  by  specialty  and 
patients  by  source  of  payment.    In  addition  quantitative  descriptors 
of  the  review  activities  were  requested.    These  included  numbers  of 
physicians  and  patients  reviewed  by  topic  and  the  number  of  patient 
visits  involved.    Finally,  distribution  of  the  variations  or  excep- 
tions to  review  criteria  were  requested  along  with  quantitative  descrip- 
tion of  the  feedback  and  intervention  function  of  the  project.  Other 
data  of  specific  significance  to  individual  projects  was  also  included 
in  the  requests. 

Quantitative  data  reports  submitted  by  the  projects  in  response 
to  these  requests  were  screened  by  HCMS  personnel  for  completeness 
and  consistency  and  follow  up  was  made  by  telephone  to  make  the  data 
as  valid  as  possible.    Some  requested  data  could  not  be  supplied  by 
the  project  because  it  was  not  available  at  the  sites  studied.  Only 
data  available  as  of  August  31,  1978  were  used  and  some  sites  were  in 
the  midst  of  the  review  cycle  at  that  time.    The  quantitative  data 
that  was  submitted  by  the  five  projects  was  formatted  by  HCMS  staff 
into  tabular  form  designed  to  be  as  consistent  as  possible  among  pro- 
jects but  still  displaying  the  unique  qualities  of  the  individual  project. 
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SITES  AND  PHYSICIANS  REVIEWED 

A  total  of  2,667  physicians  are  listed  on  the  roster  of  the  six 
hospitals  included  in  the  study.    Table  3A  displays  the  number  of  physi- 
cians at  each  site  during  1976,  tabulated  by  specialty.    Sites  range 
in  size  from  56  to  1,052  physicians.    Specialists  predominate  at  all 
sites.    Three  of  the  hospitals  (D,  E  and  F)  have  outpatient  departments, 
the  other  three  (the  smaller  hospitals)  do  not. 

TABLE  3A.    NUMBER  OF  PHYSICIANS  PRACTICING 


AT  EACH  SITE  DURING 

1976, 

TABULATED 

BY 

SPECIALTY 

Sites 

SPECIALTY 

A 

B 

C 

D 

E 

F 

TOTAL 

GENERAL/FAMILY  PRACTICE 

14 

16 

11 

0<'> 

0(D 

41 

PEDIATRICS 

17 

11 

3 

150 

38 

96 

315 

INTERNAL  MEDICINE 

24 

35 

6 

199 

63 

285 

612 

OTHER  (ALL) 

119 

77 

36 

703 

164 

600 

1699 

TOTAL 

174 

139 

56 

1052 

265 

981 

2667 

This  category  not  listed  separately  in  source  material;  may  be  included  in 
Internal  Medicine. 


Of  the  2,667  physicians  listed,  298  or  11%  were  identified  as  having 
ambulatory  patients  (other  than  hospital  OPD)  involved  in  the  study. 
Of  these  154  or  52%  had  data  meeting  the  initial  case  screening  criteria 
for  the  study  and  103  or  35%  actually  provided  ambulatory  data,  91  (88%) 
with  adult  cases  and  12  (12%)  with  pediatric  cases.    These  data  are  shown 
by  site  in  Table  3B. 
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TABLE  3B.    NUMBER  OF  PHYSICIANS  WITH  AMBULATORY  CHARTS  UNDER 


REVIEW  FROM  EACH  HOSPITAL  DURING  STUDY 

 Sites  

A  B  C  D  E  F  TOTAL 


• 

TOTAL  MDs  IDENTIFIED 

47 

50 

48 

OPD 
ONLY 

58 

95 

298 

• 

TOTAL  MDs  WITH  ELIGIBLE  DATA 

19 

33 

27 

OPD 
ONLY 

31 

44 

154 

TOTAL  MDs  PROVIDING 
AMBULATORY  DATA 

17 

24 

19 

OPD 
ONLY 

12 

31 

103 

MDs  WITH  ADULT  CASES 

12 

24 

19 

OPD 
ONLY 

7 

29 

91 

MDs  WITH  PEDIATRIC  CASES 

5 

OPD 
ONLY 

5 

2 

12 

PATIENTS  AND  VISITS  REVIEWED 

Total  admissions  for  the  six  sites  are  given  in  Table  4  together 
with  total  individual  patients  involved  and  patients  with  readmissions 
for  four  of  the  sites.    About  a  fourth  of  the  patients  admitted  to  these 
hospitals  were  readmitted  at  least  once  during  the  year.  Readmission 
rates  ranged  from  16%  to  36%. 


TABLE   4.     NUMBER  OF  READMITTED  PATIENTS  AT  EACH 

SITE— AUGUST,  1975  TO  JULY,  1976 
 Sit.ps  

A  B  C  D  E  F  TOTAL 

TOTAL  ADMISSIONS  7966     4521      8181    21,966    12,381    22,124  77,139 

TOTAL  NUMBER  INDIVIDUAL 
PATIENTS  WITH 

ADMISSIONS  7158     3850     7556       NA*        NA*     18,489  37,053 

TOTAL  NUMBER  INDIVIDUAL 
PATIENTS  WITH 

READMISSIONS  1539     1380     1217     NA*  NA*       5,459  9,595 

READMISSION  RATE  22%       36%       16%    NA*  NA*  30%  26% 


*      Data  not  collected  at  these  sites  since  methodology  required  was  too  time 
consuming 

NA     It  was  more  feasible,  time-wise,  to  collect  baseline  data  on  readmissions 
for  all  causes.    Baseline  diagnostic  specific  readmission  data  were  diffi- 
cult to  obtain  and  would  have  required  more  precise  definitions  and  greater 
expenditures  of  time  and  personnel  hours.    BPSRO  data  for  Title  XVIII  and 
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XIX  patients  for  all  Bronx  Hospitals  indicated  that  of  all  readmitted 
patients,  14%  had  a  diagnosis  of  diabetes  at  least  once,  45%  had  a  cardi- 
ovascular diagnosis  at  least  once  and  1%  had  a  diagnosis  of  asthma 
at  least  once. 


The  distribution  of  cases  reviewed  by  topic  and  site  is  given  in 
Table  5.    Note  that  of  the  610  adult  and  131  pediatric  cases  processed, 
453  (74%)  adult  and  115  (88%)  pediatric  had  ambulatory  charts  available 
and  could  be  included  in  the  study  and  of  these  384  (85%)  adult  and  85 
(74%)  pediatric  were  readmitted  cases  and  69  (15%)  adult  and  30  (36%) 
pediatric  cases  were  single  admission. 


TABLE  5.    NUMBER  OF  CASES  SAMPLED  WITH  READMISSIONS  AND  THOSE  WHOSE 
AMBULATORY  CARE  CHARTS  WERE  REVIEWED  AT  EACH  SITE 
DURING  STUDY—TABULATED  BY  TOPIC  AND  SITE 

 Sites  


TOPIC 

A 

B 

C 

D 

E 

F 

TOTAL 

ADULT  CASES 

WITH  CONGESTIVE  HEART 
FAILURE  AND  ANY  OTHER 
CONDITION 

25 

34 

26 

45 

24 

21 

175 

WITH  HYPERTENSION  AND 
ANY  OTHER  CONDITION 

38 

39 

28 

49 

27 

33 

214 

WITH  DIABETES  MELLITUS 
AND  ANY  OTHER  CONDITION 

35 

29 

16 

53 

30 

33 

196 

TOTAL  ADULT 

99 

102 

70 

161 

88 

90 

610 

PEDIATRIC  CASES 

WITH  ASTHMA 

29 

0 

0 

37 

26 

39 

131 

TOTAL  PATIENTS  WITH 
ABOVE  CLASSIFICATIONS 

128 

102 

70 

198 

114 

129 

741 

NUMBER  OF  ADULT  CASES 
WITH  AMBULATORY  CHARTS 

65 

61 

49 

92 

55 

62 

384 

NUMBER  OF  PEDIATRIC 
CASES  WITH  AMBULATORY 
CHARTS 

3 

0 

0 

37 

12 

33 

85 

TOTAL  READMITTED  CASES 
WITH  AMBULATORY  CHARTS 

68 

61 

49 

129 

67 

95 

469 
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TABLE  5  (Cont'd) 


SITES 


TOPIC 

A 

B 

C 

D 

E 

F 

TOTAL 

NUMBER  OF  ADULT  CASES 

13 

6 

27 

2 

34 

15 

69 

NUMBER  OF  PEDIATRIC 
CASES 

2 

0 

0 

2 

16 

10 

30 

TOTAL  CONTROL  (SINGLE 
ADMISSION)  CASES  WITH 
AMBULATORY  CHARTS 

15 

6 

27 

2 

34 

15 

99 

Table  6  summarizes  patient  visits  reviewed  at  each  site  for  adult 
and  pediatric  cases,  readmission,  and  single  admissions  (control),  and 
details  the  median  numbers  of  visits  by  number  of  readmissions  noted 
during  the  four-year  period  of  the  study. 

TABLE  6.    NUMBER  OF  PATIENT  VISITS  REVIEWED  AT  EACH  SITE 


TOPIC 


NO.  YRS 


SITES 


TOTAL 


ADULT  CASES 

READMISSIONS  4 

CONTROL  4 

MEDIAN  OF  VISITS 
BY  NUMBER  OF 
ADMISSIONS  PER 
READMITTED  PT. 

2  Admissions 

3  Admissions 

4  Admissions 
5+  Admissions 

PEDIATRIC  CASES 
READMISSIONS  4 

CONTROL  4 

AVERAGE  NUMBER 
OF  VISITS  PER 
READMITTED  CHILD  - 


2254        1917        1941         1818        2083        2019  12,032 
(65  pts)    (61  pts)  (49  pts)  (92  pts)  (55  pts)  (62  pts)  (384  pts) 


353  90  867 

(13  pts)    (  6  pts)  (27  pts) 


283  65  1,658 

(18  pts)  (  5  pts)  (  69  pts) 


19 

27 

14 

16 

17 

31 

36 

25 

12 

22 

26 

19 

26 

37 

27 

25 

48 

37 

53 

39 

24 

19 

54 

37 

( 


95 

(  3  pts) 

55 
pts) 


1081          170          608  1,954 

(37  pts)  (12  pts)  (33  pts)  (  85  pts) 

24          111          158  348 

pts)  (     pts)  (     pts)  (  pts) 


22.8 
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SECTION  V 
DISCUSSION  OF  REVIEW  DATA 


METHOD 

A  five  percent  random  sample  of  abstracts  for  each  topic  was 
requested  from  the  project.    HCMS  received  30  adult  abstracts,  about 
7%  of  the  total  adult  study  population,  and  10  pediatrics  abstracts, 
9%  of  the  total  studied.    In  addition  the  project  formulated  complete 
frequency  distributions  of  about  60%  of  the  379  data  items  recorded 
in  the  computer  system  used  for  the  adult  study.    This  data  involved 
the  entire  population  of  the  adult  study. 

Data  availability  rates,  defined  as  the  number  of  cases  for  which 
a  particular  data  item  was  recorded  divided  by  the  total  cases,  were 
calculated  from  the  complete  frequency  distribution  for  the  adult  popula- 
tion and  estimated  on  the  basis  of  the  sample  for  the  pediatric  study. 

ADULT  CASES:    DATA  AVAILABILITY 

Review  data  entered  into  the  computer  system  from  hospital  and 
ambulatory  abstracts  of  adult  cases  is  held  in  eight  data  files,  identi- 
fied by  the  following  file  names: 

1.  PATIENT  -  Patient  Data 

2.  HOSP  -  Hospital  Data 

3.  HOSPWU  -  Hospital  Workup 

4.  AMBWU  -  Ambulatory  Workup 

5.  CLINVIS  -  Clinic  (OPD)  Data 

6.  AMBSUM  -  Ambulatory  Summary 

7.  AMBPRSUM  -  Ambulatory  Provider  Summary 

8.  INCIDENTS  -  Diabetic,  hypertension,  CHF  and  other 

CV  incidents 
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A  total  of  379  data  items  are  stored  in  the  files.    Table  7  lists 
the  definitions  of  these  data  elements  along  with  the  percent  of  data 
availability  in  the  files  where  the  figure  is  available.    The  percent  of 
data  availability  is  defined  as  the  number  of  times  the  data  element 
contains  information,  i.e.,  codes  other  than  those  meaning  "none"  or 
"not  available"  or  "not  applicable,"  divided  by  the  total  number  of 
times  the  data  element  appeared  in  the  file.    Since  the  different  files 
contain  different  numbers  of  records,  this  denominator  varies  from  449 
cases  for  PATIENT  to  2,309  ambulatory  patient  years  for  AMBULATORY 
SUMMARY.    The  parameter  is  intended  to  give  some  insight  into  the  rela- 
tive amount  of  usable  information  in  the  system.    Data  availability 
information  was  taken  from  a  series  of  computer  runs  furnished  by  the 
PSRO  under  the  general  title  of  Marginal  Frequency  Counts  and  covers  226 
data  elements,  60%  of  the  379  data  elements  in  the  system.    The  data 
availability  rates  run  from  100%  for  21  items  to  0%  for  2  items  with  a 
mean  value  of  44%  and  a  median  value  of  35%.    A  cursory  review  of  the 
153  data  items  for  which  frequency  distributions  were  not  furnished  by 
the  PSRO  was  made  using  a  5%  random  sample  of  cases.    It  appears  that 
inclusion  of  these  items  would  somewhat  reduce  the  average  rates  of  data 
availability. 
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TABLE  7.    CRITERIA/DATA  ITEMS  AND  DATA  AVAILABILITY  RATES  ADULT  STUDY 


NUMBER 

DEFINITION  % 

DATA  AVAILABLE 

1. 

Source  hospital 

100 

2. 

Patient  number  within  source  hospital 

100 

3. 

Sex 

100 

4. 

Year  of  birth 

NA 

5. 

Race  or  ethnicity 

NA 

6. 

Ambulatory  payment  source 

NA 

7. 

Source  for  funding  data 

NA 

8. 

Total  known  admissions  to  source  hospital 

100 

9. 

Admissions  prior  to  four-year  period 

6 

10. 

Admissions  in  four-year  period 

100 

11. 

Admissions  after  four-year  period 

21 

12. 

All  study  diagnoses  involved 

100 

13. 

Selected  non-study  diagnoses  involved 

65 

14. 

Admission  date  of  first  admission  for  study  diagnosis 

100 

15. 

Diagnosis  for  that  admission 

99 

16. 

Class  on  admission 

83 

17. 

Class  on  discharge 

60 

18. 

Number  of  admissions  to  other  hospitals 

14 

19. 

Specific  second  hospital 

14 

20. 

Diagnosis  involved 

8 

L  1  . 

WnmKoK>  n-f  cnnrro  hncni+al   aHmi<;<;inn?  not  ah^tract&d 

11 

22. 

Source  of  first  ambulatory  care  provider 

100 

23. 

Specific  first  provider 

100 

24. 

Provider  1  chart  status 

100 

25. 

Source  of  second  ambulatory  care  provider 

25 

NA  --  Marginal  frequency  count  not  available. 
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TABLE  7  (Cont'd) 

NUMBER   DEFINITION   %  DATA  AVAILABLE 

26.  Specific  second  provider  25 

27.  Provider  2  chart  status  25 

28.  Source  of  third  ambulatory  care  provider  6 

29.  Specific  third  provider  6 

30.  Provider  3  chart  status  6 

31.  Other  ambulatory  care  providers  11 

32.  Specific  provider  listed  100 

33.  Charts  available  for  review  NA 

34.  Date  of  first  ambulatory  visit  97 

35.  Number  of  ER  visit  43 

36.  Total  number  of  ambulatory  visit  98 

37.  Number  of  unrelated  admissions  16 

38.  Number  of  possibly  unrelated  admissions  7 

39.  Study  criteria  problems  15 

40.  Number  of  home  visits  5 

41.  Data  problem  for  reviewed  charts  13 

42.  Date  of  death  13 

43.  Card  identification  100 

44.  Number  of  specific  admission  100 

45.  Date  of  specific  admission  100 

46.  Date  of  specific  discharge  100 

47.  Other  contact  within  24  hours  prior  to  admission  NA 

48.  Other  contact  within  one  to  seven  days  prior  to 
admission  NA 

49.  First  admission  diagnosis  for  specific  admission  96 

50.  Second  admission  diagnosis  for  specific  admission  50 
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TABLE  7  (CONT'D) 

NUMBER   DEFINITION   %  DATA  AVAILABLE 


51. 

Class  of  hypertension  on  admission 

NA 

52. 

Class  of  diabetes  on  admission 

94 

53. 

Admission  justification 

NA 

54. 

Specific  study  condition  other  than  DM  or  HT 

95 

55. 

Class  on  admission  of  other  study  condition 

35 

56. 

Medications  mentioned  on  admission 

NA 

57. 

Completed  months  from  preceding  discharge  to  this 
admission 

91 

58. 

Number  of  ambulatory  visits  in  that  period 

58 

59. 

Number  of  providers  involved  in  those  visits 

NA 

60. 

Selected  specific  procedures 

84 

61. 

Consultant  referrals 

NA 

62. 

First  diagnosis  on  discharge 

NA 

63. 

Second  diagnosis  on  discharge 

NA 

64. 

Class  of  HT  on  discharge 

88 

65. 

Class  of  diabetes  on  discharge 

88 

66. 

Class  of  other  study  condition  on  discharge 

20 

67. 

Medications  mentioned  on  discharge 

NA 

68. 

Death  in  hospital 

3 

69. 

Class  of  HT  on  ambulatory  visit  within  24  hours  of 
admi  ssion 

95 

70. 

Class  of  DM  on  ambulatory  visit  within  24  hours  of 
admission 

95 

71. 

Other  contact  within  8  to  31  days  prior  to  admission 

94 

72. 

Basis  for  HT  classification  on  admission 

95 

73. 

Basis  for  DM  classification  on  admission 

95 

74. 

Basis  for  HT  classification  on  discharge 

94 

75. 

Basis  for  DM  classification  on  discharge 

65 

93 

TABLE  7  (CONT'D) 


NUMBER   DEFINITION   %  DATA  AVAILABLE 


76 

Selected  medications  not  included  in  other  variable 

6 

77. 

Admission's  relationship  to  study  conditions 

95 

78. 

12-month  periods  defined  by  last  admission  in  four 
years 

100 

79. 

Exact  date  for  end  of  12-month  period 

NA 

80. 

Number  of  admission  in  12-month  period 

39 

81. 

Number  of  inhospital  days  in  12-month  period 

39 

82. 

Sites  of  ambulatory  care 

63 

83. 

Numbber  of  ambulatory  providers  seen  in  year 

63 

84. 

Total  number  of  known  ambulatory  visits  in  year 

64 

85. 

Primary  condition  in  year 

57 

86. 

Severity  of  diabetes  for  year 

37 

87. 

Severity  of  hypertension  in  year 

59 

88. 

Severity  of  CHF  for  year 

31 

89. 

Severity  of  Angina/MI/CAD  in  year 

27 

90. 

Severity  of  PVD  in  year 

6 

91. 

Number  of  diabetic  incidents  in  year 

7 

92. 

Number  of  hypertensive  incidents  in  year 

21 

93. 

Number  of  CHF  class  changes  in  year 

NA 

94. 

Number  of  class  changes  for  Angina/MI/CAD 

NA 

95. 

Class  changes  for  PVD  in  year 

NA 

96. 

CVAs  in  year 

NA 

97. 

Times  increased  rales  mentioned 

NA 

98. 

Preadmission  total  and  abnormal  BUNs 

NA 

99. 

Preadmission  potassium  tests 

NA 

100. 

Preadmission  EKG 

66 

NA 

TABLE  7  (CONT'D) 

NUMBER   DEFINITION   %  DATA  AVAILABLE 

101.  Preadmission  chest  films  NA 

102.  Preadmission  lipids  NA 

103.  Preadmission  lung  examination  NA 

104.  Preadmission  heart  examination  NA 

105.  Preadmission  leg  examination  NA 

106.  Preadmission  fundi  examination  NA 

107.  Preadmission  skin  examination  NA 

108.  Other  abnormal  BUNs  NA 

109.  Other  abnormal  potassium  tests  NA 

110.  Other  abnormal  EKGs  NA 

111.  Other  abnormal  chest  films  NA 

112.  Other  abnormal  lipids  NA 

113.  Other  times  rales  heard  NA 

114.  Other  times  new  murmurs  heard  NA 

115.  Other  times  edema  found  12 

116.  Other  times  fundi  changes  seen  4 

117.  Other  times  skin  lesions  seen  3 

118.  Specific  provider  involved  in  this  data  97 

119.  Visits  with  this  provider  this  year  97 

120.  Visits  with  dates  only  18 

121.  Visits  with  date  and  diagnoses  only  9 

122.  Visits  with  blood  pressure  readings  87 

123.  Visits  with  blood  sugars  47 

124.  Visits  with  sugar  in  urine  measured  38 

125.  Visits  with  acetone  in  urine  measured  35 
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TABLE  7  (CONT'D 


) 


NUMBER 

DEFINITION 

%  DATA  AVAILABLE 

126. 

Vis- 

its 

with 

weight  taken 

61 

127. 

Vis- 

'ts 

with 

temperatures  taken 

4 

128. 

Vis- 

its 

with 

fundi  examinations 

10 

129. 

Vis- 

'ts 

with 

heart  examinations 

59 

130. 

Vis- 

'ts 

with 

lung  examinations 

58 

131. 

Vis- 

its 

with 

liver  examinations 

15 

132. 

Vis- 

"ts 

with 

feet  examinations 

9 

133. 

Vis- 

'ts 

with 

peripheral  pulse  readings 

7 

134. 

Vis- 

ts 

with 

neurological  examinations 

5 

135. 

Vis- 

'ts 

with 

skin  examinations 

12 

136. 

Vis- 

ts 

with 

cultures 

3 

137. 

Vis- 

'ts 

with 

WBCs 

16 

138. 

Vis- 

ts 

with 

EKGs 

38 

139. 

Vis- 

ts 

with 

stress  tests 

1 

140. 

Vis- 

'ts 

wi  th 

chest  x-rays 

24 

141. 

Vis- 

ts 

with 

angiograms 

2 

142. 

Vis- 

ts 

wi  th 

BUNs 

33 

143. 

Vis- 

ts 

with 

microscopic  urinalysis 

4 

144. 

Vis- 

ts 

with 

SGOTs 

15 

145. 

Vis- 

ts 

wi  th 

lipids/cholesterol/trigl .  test 

14 

T  AC 

VI  s 

ts 

wi  th 

potassium  tests 

23 

147. 

Vis- 

ts 

with 

hyperglycemia  symptoms 

2 

148. 

Vis- 

ts 

with 

general  (diabetes)  symptoms 

5 

149. 

Visi 

ts 

with 

weakness,  fatigue 

15 

150. 

Visi 

ts 

with 

skin  symptoms 

21 
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TABLE  7  (CONT'D) 


NUMBER   DEFINITION   %  DATA  AVAILABLE 

151.  Visits  with  cardiac  symptoms  46 

152.  Visits  with  urinary  tract  symptoms  NA 

153.  Visits  with  PVD  symptoms  NA 

154.  Visits  with  headaches  NA 

155.  Visits  with  mental  distress  symptoms  14 

156.  Visits  with  "better"  as  only  symptom  15 

157.  Visits  with  "worse"  as  only  symptom  1 

158.  Visits  with  "no  change"  as  only  symptom  14 

159.  Number  of  diabetes  incidents  in  year  10 

160.  Number  of  hypertension  incidents  in  year  30 

161.  Number  of  other  incidents  in  year  41 

162.  Number  of  broken  appointments  in  year  10 

163.  Other  noncompliance  in  year  8 

164.  Mention  of  insulin  14 

165.  Mention  of  digitalis  32 

166.  Mention  of  diuretics  51 

167.  Mention  of  nondiuretic  hypotensives  28 

168.  Mention  of  hypotensives  +  diuretics  6 

169.  Mention  of  nitroglycerine  or  propanolol  12 

170.  Mention  of  DBI  7 

171.  Mention  of  other  oral  hypoglycemics  16 

172.  Mention  of  other  heart  medication  13 

173.  Mention  of  tranquilizers  7 

174.  Mention  of  anticoagulants  3 

175.  Mention  of  B12  NA 
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TABLE  7  (CONT'D) 

NUMBER   DEFINITION   %  DATA  AVAILABLE 

176.  Emergency  room  visits  23 

177.  OPD  visits  27 

178.  Number  of  clinics  involved  27 

179.  Name  of  clinic  27 

180.  Number  of  visits  to  that  clinic  in  year  27 

181.  Count  of  diabetic  incidents  NA 

182.  Description  of  diabetic  incidents  NA 

183.  Action  re  orals  on  same  visit  NA 

184.  Action  re  insulin  on  same  visit  NA 

185.  Base  dosage  of  insulin  before  incident  NA 

186.  Other  response  on  same  visit  NA 

187.  Later  action  re  orals  NA 

188.  Later  response  re  insulin  NA 

189.  Later  response  other  than  oral  insulin  NA 

190.  Number  of  visits  to  later  response  NA 

191.  Time  to  later  response  NA 

192.  Count  of  hypertensive  incidents  NA 

193.  Description  of  hypertensive  incident  NA 

194.  Action  re  diuretics  on  same  visit  NA 

195.  Action  re  hypotensives  on  same  visit  NA 

196.  Action  re  combined  drugs  on  same  visit  NA 

197.  Action  re  tranquillizers  on  same  visit  (Hyp)  NA 

198.  Other  response  on  same  visit  NA 

199.  Later  action  re  diuretics  NA 

200.  Later  action  re  hypotensives  NA 
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TABLE  7  (CONT'D) 


NUMBER   DEFINITION   %  DATA  AVAILABLE 

201.  Later  response  re  combined  drug  NA 

202.  Later  response  re  tranquilizers  NA 

203.  Other  later  response  NA 

204.  Visits  to  later  response  NA 

205.  Time  to  later  response  NA 

206.  Count  of  other  incidents  NA 

207.  Description  of  "other"  incidents  NA 

208.  Action  re  digitalis  on  same  visit  NA 

209.  Action  re  nitrogen/propanolol  on  same  visit  NA 

210.  Action  re  anticoagulants  on  same  visit  NA 

211.  Action  re  tranquilizers  on  same  visit  (other)  NA 

212.  Other  action  on  same  visit  NA 

213.  Later  digitalis  action  NA 

214.  Later  action  re  nitroglycerin/propanolol  NA 

215.  Later  action  re  anticoagulants  NA 

216.  Later  tranquilizer  action  NA 

217.  Other  later  response  NA 

218.  Number  of  visits  to  later  response  NA 

219.  Time  to  later  response  NA 

220.  First  contact  prior  to  4-year  period  30 

221.  Number  of  visits  prior  to  4-year  period  52 

222.  Date  of  first  visit  in  study  period  100 

223.  Date  of  last  visit  in  study  period  100 

224.  Number  of  visits  between  two  preceding  dates  100 

225.  Date  of  hypertension  history  (amb)  37 
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TABLE  7  (CONT'D) 

NUMBER   DEFINITION   %  DATA  AVAILABLE 

226.  Year  of  onset  of  hypertension  (amb)  8 

227.  Type  of  onset  of  hypertension  (amb)  0 

228.  Date  of  heart  disease  history  (amb)  44 

229.  Year  of  onset  of  heart  disease  (amb)  42 

230.  Date  of  diabetes  history  (amb)  35 

231.  Year  of  onset  of  diabetes  (amb)  35 

232.  Medication  history  (amb)  17 

233.  Date  of  cardiovascular  review  (amb)  NA 

234.  Cardiovascular  review  finding  (amb)  37 

235.  Date  of  renal  function  review  (amb)  NA 

236.  Renal  function  review  findings  (amb)  9 

237.  Date  of  diet  history  (amb)  NA 

238.  Type  of  diet  history  (amb)  27 

239.  History  re  alcoholism  (amb)  8 

240.  History  re  drugs  (amb)  0 

241.  History  re  smoking  (amb)  9 

242.  History  re  disabilities  (amb)  5 

243.  History  re  occupation  12 

244.  Literacy  history  (amb)  20 

245.  Date  of  initial  treatment  plan  (amb)  77 

246.  Medications  in  initial  treatment  plan  (amb)  72 

247.  Referrals  in  initial  treatment  plan  (amb)  5 

248.  Advice  in  initial  treatment  plan  (amb)  13 

249.  Number  of  ambulatory  workups  NA 

250.  Date  of  first  admission  NA 
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TABLE  7  (CONT'D) 

NUMBER   DEFINITION   %  DATA  AVAILABLE 

251.  Admissions  prior  to  4-year  period  6 

252.  Admission  date  of  first  admission  in  four  years  100 

253.  Number  of  different  admissions  in  workup  data  99 

254.  Number  of  first  admission  in  workup  100 

255.  Date  of  hypertension  history  (hosp)  57 

256.  Year  of  onset  of  hypertension  (hosp)  57 

257.  Type  of  onset  of  hypertension  (hosp)  1 

258.  Date  of  heart  disease  history  (hosp)  NA 

259.  Year  of  onset  of  heart  disease  (hosp)  NA 

260.  Date  of  diabetes  history  (hosp)  NA 

261.  Year  of  onset  of  diabetes  (hosp)  NA 

262.  Medication  history  (hosp)  47 

263.  Date  of  cardiovascular  review  (hosp)  NA 

264.  Cardiovascular  review  findings  (hosp)  NA 

265.  Date  of  renal  function  review  (hosp)  NA 

266.  Renal  function  review  findings  (hosp)  15 

267.  Date  of  diet  history  (hosp)  NA 

268.  Type  of  diet  history  (hosp)  63 

269.  History  re  alcoholism  (hosp)  47 

270.  History  re  drugs  (hosp)  16 

271.  History  re  smoking  (hosp)  51 

272.  History  re  disabilities  (hosp)  9 

273.  History  re  occupation  (hosp)  38 

274.  Literacy  history  (hosp)  48 

275.  Date  of  initial  treatment  plan  (hosp)  85 
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TABLE  7  (CONT'D) 

NUMBER   DEFINITION   %  DATA  AVAILABLE 

276.  Medications  in  initial  treatment  plan  (hosp)  72 

277.  Referrals  in  initial  treatment  plan  (hosp)  22 

278.  Advice  in  initial  treatment  plan  (hosp)  23 

279.  First  visit  to  this  provider  in  study  period  NA 

280.  Relative  date  of  blood  pressure  NA 

281.  Systolic  blood  pressure  (amb)  NA 

282.  Diastolic  blood  pressure  (amb)  NA 

283.  Relative  date  of  pulse  rate  60 

284.  Pulse  rate  (amb)  NA 

285.  Relative  date  of  weight  68 

286.  Weight-base  (amb)  NA 

287.  Relative  date  of  height  6 

288.  Height-base  (amb)  NA 

289.  Relative  date  of  skin  examination  21 

290.  Skin  examination-base  (amb)  NA 

291.  Relative  date  of  neurological  examination  18 

292.  Neurological  examination-base  (amb)  NA 

293.  Relative  date  of  funduscopic  22 

294.  Funduscopic  findings-base  (amb)  NA 

295.  Relative  date  of  heart  examination  73 

296.  Heart  examination  findings-base  (amb)  NA 

297.  Relative  date  of  lung  examination  75 

298.  Findings  of  lung  examination-base  (amb)  NA 

299.  Relative  date  of  liver  examination  29 

300.  Findings  of  liver  examination- base  (amb)  NA 
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TABLE  7  (CONT'D) 


NUMBER   DEFINITION   %  DATA  AVAILABLE 

301.  Relative  date  of  abdominal  bruits  10 

302.  Abdominal  bruits-base  (amb)  NA 

303.  Relative  date  of  carotid  bruits  3 

304.  Carotid  bruits-base  (amb)  NA 

305.  Relative  date  re  peripheral  edema  56 

306.  Peripheral  edema  findings-base  (amb)  NA 

307.  Relative  date  re  peripheral  pulses  14 

308.  Peripheral  pulse  findings-base  (amb)  NA 

309.  Relative  date  of  urinalysis  47 

310.  Base  urinalysis  findings  (amb)  NA 

311.  Relative  date  of  EKG  54 

312.  Base  EKG  findings  (amb)  NA 

313.  Relative  date  of  chest  film  42 

314.  Base  chest  film  findings  (amb)  NA 

315.  Relative  date  of  BUN-creatinine  53 

316.  Base  BUN  findings  (amb)  NA 

317.  Relative  date  of  blood  glucose  58 

318.  Base  blood  glucose  findings  (amb)  NA 

319.  Relative  date  re  NA/k  33 

320.  Base  NA/k  findings  (amb)  NA 

321.  Relative  date  re  cholesterol  27 

322.  Base  cholesterol  findings  (amb)  NA 

323.  Relative  date  re  GTT  0 

324.  Base  GTT  findings  (amb)  NA 

325.  Relative  date  of  FBS  3 
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TABLE  7  (CONT'D) 


NUMBER   DEFINITION   %  DATA  AVAILABLE 

326.  Base  FBS  findings  (amb)  NA 

327.  Relative  date  of  CBC  NA 

328.  Base  CBC  findings  (amb)  NA 

329.  Number  of  other  laboratory  tests  NA 

330.  Relative  admission  number  for  blood  pressure  NA 

331.  Systolic  blood  pressure  (hosp)  NA 

332.  Diastolic  blood  pressure  (hosp)  97 

333.  Relative  admission  number  for  pulse  rate  NA 

334.  Pulse  rate  (hosp)  NA 

335.  Relative  admission  number  for  weight  NA 

336.  Weight-base  (hosp)  63 

337.  Relative  admission  number  for  height  NA 

338.  Height-base  (hosp)  NA 

339.  Relative  admission  number  of  skin  examination  NA 

340.  Skin  examination-base  (hosp)  64 

341.  Relative  admission  number  of  neurological  examination  NA 

342.  Neurological  examination-base  (hosp)  70 

343.  Relative  admission  number  of  funduscopic  NA 

344.  Funduscopic  base  findings  (hosp)  61 

345.  Relative  admission  number  of  heart  examination  NA 

346.  Heart  examination  findings  (hosp)  NA 

347.  Relative  admission  number  of  lung  examination  NA 

348.  Findings  of  lung  examination-base  (hosp)  98 

349.  Relative  admission  number  of  liver  examination  NA 

350.  Findings  of  liver  examination-base  (hosp)  69 
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TABLE  7  (CONT'D) 


NUMBER   DEFINITION   %  DATA  AVAILABLE 

351.  Relative  admission  number  of  abdominal  bruit  NA 

352.  Abdominal  bruit-base  (hosp)  26 

353.  Relative  admission  number  of  carotid  bruits  NA 

354.  Carotid  bruits-base  (hosp)  16 

355.  Relative  admission  number  re  peripheral  edema  NA 

356.  Peripheral  edema  findings-base  (hosp)  73 

357.  Relative  admission  number  re  peripheral  pulse  NA 

358.  Peripheral  pulse  findings-base  (hosp)  53 

359.  Relative  admission  number  of  urinalysis  NA 

360.  Base  urinalysis  findings  (hosp)  94 

361.  Relative  admission  number  of  EKG  95 

362.  Base  EKG  findings  (hosp)  95 

363.  Relative  admission  number  of  chest  film  NA 

364.  Base  chest  film  findings  (hosp)  95 

365.  Relative  admission  number  of  BUN-creatinine  NA 

366.  Base  BUN  findings  (hosp)  95 

367.  Relative  admission  number  of  blood  glucose  NA 

368.  Base  blood  glucose  findings  (hosp)  91 

369.  Relative  admission  number  re  NA/k  NA 

370.  Base  NA/k  finding  (hosp)  76 

371.  Relative  admission  number  re  cholesterol  54 

372.  Base  cholesterol  findings  (hosp)  54 

373.  Relative  admission  number  of  GTT  NA 

374.  Base  GTT  finding  (hosp)  2 

375.  Relative  admission  number  of  FBS  NA 
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TABLE  7  (CONT'D) 


NUMBER   DEFINITION   %  DATA  AVAILABLE 

376.  Base  FBS  findings  (hosp)  8 

377.  Relative  admission  number  of  CBC  NA 

378.  Base  CBC  findings  (hosp)  1 

379.  Number  of  other  laboratory  tests  (hosp)  1 
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One  of  the  most  important  elements  in  the  analysis  of  the  review 
data  collected  by  the  BPSRO  project  was  the  time  factor.  Ambulatory 
data  were  recorded  by  study  year  counting  backwards  in  time  from  the 
hospitalization  which  qualified  the  case  for  the  study.    The  period  of 
12  months  prior  to  the  hospitalization  was  designated  as  "year  one,"  the 
next  previous  12  months  as  "year  two,"  etc.    Year  zero  was  used  for 
ambulatory  data  collected  subsequent  to  the  key  hospitalization.  Table 
8  provides  an  illustration  of  the  extent  of  this  kind  of  data  as  stored 
in  file  AMBPRSUM  (Ambulatory  Provider  Summary  file).    Counts  of  the 
number  of  patients  and  number  of  encounters  recorded  in  the  file  for 
each  study  year  are  shown  for  a  random  sample  of  30  cases,  about  7%  of 
the  total  cases. 

Figure  3  is  a  map  of  a  few  of  these  30  cases  across  calendar  time 
showing  hospitalization  and  ambulatory  visits.    Length  of  stay  is  indi- 
cated for  each  hospitalization  and  diagnosis  for  Diabetes  Mellitus, 
Hypertension  and  any  of  the  heart  problems  studied. 
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TABLE  8.    DATA  FROM  ANNUAL  PROVIDER  SUMMARY  FILE  -  AMBULATORY 
ADULT  STUDY— SAMPLE  TOTAL,  30  CASES 


YEAR  OF  STUDY 


CRITERIA/DATA  ITEM 


ZERO 


ONE 


TWO 


THREE 


FOUR 


TNTJTV 


TOTAL 
— PAT 


TUTA1 


AMB  VISITS 

Total  20(67) 

Dates  Only  2(  7) 
Diagnosis  and  Dates 

Only  2(  7) 

PHYS  EXAM 

Blood  Pressure  20(67) 

Blood  Sugar  6(20) 

Sugar  in  Urine  5(17) 

Acetone  in  Urine  5(17) 

Weight  13(43) 

Temperature  2(  7) 

Fundi  2(  7) 

Heart  Exam  14(47) 

Lung  Exam  15(50) 

Liver  Exam  2(  7) 

Foot  Exam  0 

Peripheral  Pulse  3(10) 

Neurological  Exam  1(  3) 

Skin  Exam  2(  7) 

DIAGNOSTIC  TESTS 

Cultures  1(  3) 

WBC  3(10) 

EKG  7(23) 

Stress  Test  1(  3) 

Chest  X-Ray  6(20) 

Angiogram  0 

BUN  3(10) 

Micro  UA  1(3) 

SGOT  4(13) 

Lipid/Chlor/Trig  3(10) 

Potassium  Test  6(20) 


199  26(87) 
18  4(13) 

6       2(  7) 


124 
25 
12 
12 
77 
2 
4 
64 
64 
7 
0 
3 
1 
5 


1 

13 
9 
1 
7 
0 

14 
3 
4 
4 

11 


24(80) 
13(43) 
11(37) 
10(33) 
19(63) 
K  3) 
2(  7) 
19(63) 
20(67) 
7(23) 
3(10) 
1  (  3) 
2(  7) 
4(13) 


0 

4(13) 
12(40) 
0 

7(23) 
1  (  3) 
12(40) 
2(  7) 
6(20) 
6(20) 
8(27) 


265  19(63) 
27  7(23) 


217     17(57)  177 
33       4(13)  31 


2 

2(  7) 

3 

0 

0 

165 

18(60) 

131 

16(53) 

103 

42 

9(27) 

29 

7(23) 

33 

27 

5(17) 

26 

8(27) 

26 

27 

5(17) 

26 

8(27) 

22 

130 

16(53) 

97 

14(47) 

68 

2 

1(  3) 

3 

0 

0 

4 

1  (  3) 

1 

K  3) 

1 

90 

11(37) 

43 

8(27) 

22 

101 

11(37) 

49 

7(23) 

31 

28 

3(10) 

8 

2(  7) 

4 

12 

2(  7) 

4 

3(10) 

4 

1 

1(  3) 

2 

4(13) 

4 

4 

0 

0 

2(  7) 

2 

9 

0 

0 

3(10) 

5 

0 

0 

0 

1  (  3) 

1 

6 

K  3) 

1 

3(10) 

4 

24 

10(33) 

23 

7(23) 

23 

0 

K  3) 

2 

1  (  3) 

1 

8 

4(13) 

5 

4(13) 

4 

1 

1  (  3) 

1 

0 

0 

32 

5(17) 

23 

6(20) 

18 

3 

1  (  3) 

1 

2(  7) 

6 

9 

2(  7) 

5 

2(  7) 

3 

10 

1  (  3) 

4 

1  (  3) 

2 

19 

6(20) 

19 

5(17) 

11 

12(40) 
2(  7) 


9(30) 

5(17) 

3(10) 

4(13) 

9(30) 

1(  3) 

2(  7) 

5(17) 

5(17) 

3(10) 

2(  7) 

0 

0 

K  3) 


0 
0 

4(13) 
1  (  3) 
K  3) 
0 

3(10) 
K  3) 
2(  7) 
1  (  3) 
3(10) 


94 

30(100) 

94 

952 

3 

11 (  37) 

19 

112 

0 

4(  13) 

6 

11 

50 

29(  97) 

87 

573 

16 

14(  47 

39 

145 

6 

14(  47) 

32 

97 

1 1 

1  A  f     A  "7  \ 

14(  47) 

6c 

no 

yts 

33 

25(  83) 

71 

405 

1 

4(  13) 

5 

8 

2 

4(  13) 

8 

12 

12 

23(  77) 

57 

231 

12 

22(  73) 

58 

257 

3 

9(  30) 

17 

50 

4 

5(  17) 

10 

24 

0 

8(  27) 

9 

10 

0 

3(  10) 

5 

7 

1 

8(  27) 

10 

20 

0 

2(  7) 

2 

2 

0 

8(  27) 

11 

24 

7 

15(  17) 

40 

86 

1 

3(  10) 

4 

5 

2 

12  40) 

22 

26 

0 

2(  7) 

2 

2 

9 

14(  49) 

29 

96 

2 

3(  10) 

7 

15 

4 

10(  33) 

16 

25 

2 

8(  27) 

12 

22 

3 

10(  33) 

29 

63 

TABLE  8  (CONT'D) 


YEAR  OF  STUDY 


ZERO 


ONE 


TWO 


THREE 


FOUR 


TOTAL 


CRITERIA/DATA  ITEM 


INDIV    PAT.  TOTAL 


SYMPTOMS 


Hypoglycemia 

1(  3) 

2 

0 

0 

0 

7) 

0 

0 

0 

Diabetes,  General 

0 

0 

1(  3) 

1 

21 

2 

0 

0 

Weak,  Fatigue 

2(  7) 

2 

4(13) 

11 

21 

7) 

5 

K  3) 

2 

Skin 

0 

0 

1  3) 

1 

0 

0 

0 

0 

Cardiac 

7(23) 

20 

12(40) 

40 

7 

23) 

22 

11(37) 

23 

Urinary  Tract 

0 

0 

2(  7) 

2 

1 

3) 

1 

1(  3) 

1 

PVD 

0 

0 

0 

0 

1! 

3) 

1 

0 

0 

Headaches 

2(  7) 

3 

3(10) 

5 

2 

'  7) 

2 

3(10) 

3 

Mental 

4(13) 

4 

3(10) 

7 

3 

'10) 

6 

3(10) 

3 

QUAL.  OF  SYMPTOMS 

Better  3(10) 

Worse  0 

No  Change  4(13) 

INCIDENTS 

Diabetic  3(10) 

Hypertensive  6(20) 

Other  8(27) 

NONCOMPLIANCE 
Broken  Appointment  3(10) 

Other  4(13) 

TREATMENTS 

Insulin  3(10) 

Digitalis  11(37) 

Diuretics  13(43) 

Hypotensives  6(20) 
Hypotensives  and 

Diuretics  1(  3) 


3 

2(  7) 

5 

2( 

7) 

2 

3(10) 

4 

K  3) 

0 

0 

0 

1  ( 

3) 

1 

K  3) 

1 

1  3) 

10 

5(17) 

8 

2( 

7) 

3 

3(10) 

6 

3(10) 

0 
0 

1(3) 
0 

4(13) 

0 

0 

H  3) 
K  3) 


6 

6(20) 

7 

3(10) 

5 

3(10) 

4 

1  (  3) 

15 

11(37) 

26 

5(17) 

15 

7(23) 

15 

4(13) 

21 

14(47) 

39 

9(30) 

15 

8(27) 

14 

6(20) 

8 

4(13) 

15 

4(13) 

16 

3(10) 

16 

1(  3) 

4(13) 

3(10) 

0 

0 

6(20) 

5(17) 

3(10) 

M  3) 

14(47) 

8(27) 

4(13) 

3(10) 

17(57) 

12(40) 

10(33) 

1(  3) 

8(27) 

7(28) 

7(23) 

3(10) 

1  (  3) 

1  (  3) 

2(  7) 

2(  7) 

0 
0 

1 

0 
7 
0 
0 

1 
1 


2 
2 
6 


3 
6 
7 


1 

(  3) 

1 

3 

(  10) 

3 

6 

(  20) 

10 

3 

(  10) 

1 

17 

(  57) 

41 

4 

(  13) 

4 

1 

(  3) 

1 

7 

(  23) 

11 

6 

(  20) 

14 

5 

(  17) 

11 

2 

(  7) 

3 

8 

,  27) 

17 

7 

[  23) 

16 

15 

[  50) 

33 

20 

!  67) 

45 

8 

'  27) 

15 

8 

!  27) 

11 

7 

'  23) 

18 

18 

;  60) 

40 

21 

,  70) 

53 

15 

'  50) 

31 

3(  10) 

7 

TABLE  8  (CONT'D) 


YEAR  OF  STUDY 


CRITERIA/DATA  ITEM 


TREATMENTS  (CONT'D) 
Nitro/Propanolol  2(  7) 
DBI  0 
Other  Oral  Hypoten- 
sives 2(  7) 
Other  Heart  4(13) 
Tranquilizers  4(13) 
Anticoagulant  1(3) 
B12  1(  3) 


ZERO  ONE 
PAT(%)    ENCTR    PAT(%)  ENCTR 


TWO 

PAT(%)  ENCTR 


THREE 
PAT(%)  ENCTR 


FOUR 
PAT(%)  ENCTR 


TOTAL 
PAT. 


INDIV.  PAT.  TOTAL 
PAT  {%)  YEARS  ENCTR. 


3(10) 
0 

2(  7) 
4(13) 
9(30) 
1(  3) 
2(  7) 


2(  7) 
0 

1  (  3) 
2(  7) 
4(13) 
3(10) 
2(  7) 


2(  7) 
0 

2(  7) 

2(  7) 
5(17) 

1  (  3) 

2(  7) 


0 
0 

2(  7) 
0 

3(10) 
0 

1  (  3) 


6(  20) 

2(  7) 

5(  17) 

7(  23) 

15(  50) 

4(  13) 

4(  13) 


9 
0 

9 
12 
25 
6 
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FIGURE  3 

ILLUSTRATIVE  PATIENT  PROFILES  -  ADULT  STUDY 
SIX  PATIENT  PROFILES,  SELECTED  AS  REPRESENTATIVE  OF  THE  EXTENT 
OF  HOSPITAL  AND  AMBULATORY  DATA  COLLECTED  BY  THE  PROJECT 
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Pediatric  Study 

Review  data  for  the  115  pediatric  asthma  cases  was  recorded  on 
McBee  cards.    While  the  organization  of  data  followed  the  general 
pattern  of  the  adult  study,  fewer  data  elements  were  recorded  and  rela- 
tively simple  manual  procedures  were  used  for  recording  and  tabulation. 
Table  9A  lists  the  criteria/data  items  recorded  on  the  McBee  cards  for 
each  case  and  Table  9B  lists  those  data  items  recorded  by  study  year. 
On  both  tables  the  number  of  patients  for  whom  data  were  recorded  and 
the  number  of  encounters  recorded  for  those  patients  were  taken  from  a 
random  sample  of  10  cases,  9%  of  the  total  of  115  cases  in  the  study. 

For  data  in  Table  9B  study  year  was  defined,  as  in  the  adult  study, 
in  terms  of  12-month  periods  counting  backwards  from  the  key  hospitaliza- 
tion.   The  "x  year"  is  used  to  indicate  ambulatory  data  collected  after 
that  hospitalization  and  corresponds  to  "year  zero'-'  in  the  adult  study. 
The  percentage  shown  may  be  interpreted  as  data  availability  rates, 
i.e.,  the  number  of  patient  years  with  that  datum  recorded  divided  by 
the  number  of  patient  years  for  which  it  could  have  been  recorded. 
The  data  availability  rates  range  from  100%  for  5  items  to  0%  (blanks) 
for  52  items.    The  mean  availability  rate  is  30%  for  the  176  data  items, 
the  median  rate,  20%. 
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TABLE  9A.    PEDIATRIC  ASTHMA  REVIEW  DATA  BY  CASE 
Sample  Total,  10  Cases 


CRITERIA/DATA  ITEM  NO.  PATIENTS  (%)       NO.  ENCOUNTERS 


Hospital  Identification  10  (100) 

Age  10  (100) 

Age  at  Onset  10  (100) 

INITIAL  WORKUP 

Family  History  9  (90) 

Diet  History  9  (90) 

Drug  Allergy  3  (30) 

Frequency  of  Attacks  7  (70) 

Progress  of  Symptoms  6  (60) 

Allergy  Testing  3  (30) 

Desensitization  3  (30) 

Psychologic  Adjustment  6  (60) 

Immunizations  6  (60) 

Developmental  Assessment  8  (80) 

PHYSICAL  EXAMINATION 

Ears,  Nose,  Throat  9  (90) 

Lungs  9  (90) 

Respiratory  Rate  9  (90) 

Pulse  8  (80) 

DIAGNOSTIC  TESTS 

Complete  Blood  Count  10  (100) 

Urinalysis  10  (100) 

Tuberculin  8  (80) 

Sweat  Test  1  (10) 

Immunoglobulin  1  (10) 

Other  Major  Disease  1  (10) 

Chest  X-Ray  6  (60) 

ADMISSIONS 

Asthma  Only  8  (80)  43 

Death  1  (10) 
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TABLE  9B.    PEDIATRIC  ASTHMA  REVIEW  DATA  BY  STUDY  YEAR 


YEAR  OF  STUDY 


TOTAL 


X  YEAR 


ONE 


TWO 


THREE 


FOUR 


CRITERIA/DATA  ITEM 


indiv.  pat.  Total 


00 


Hospital  Admission 
Other  Hospitalization 
Respiratory  Admission 
Other  Nonrelated 

Admission 
OPD 
LMD 
GP 
PED 

Ambulatory  Visit 
Emergency  Room  Visit 


1(10) 


1(10) 


6(60) 
4(40) 


RX 


Bronchodilators  4(40) 
Antihistamine  Expect. 


Cromolyn 
Steroids 
Other 
Advice 
Refer 
Sch.  Abs. 

CLASS 
Mild 

Moderate 
Severe 

VISITS 
1Q 

2-3Q 
4Q 

Asthma  Only 
Respiratory 
Other  Vsiit 
Lung  Exam 
Abnormal  Findings 
Abnormal  Findings 
Total  Records 


2(20) 
1(10) 
1(10) 

1(10) 


1(10) 


1(10) 
2(20) 

2(20) 
1(10) 
4(40) 
4(40 
5(50 
2  20 
8(80 


2     10(100)  25 

2(  20) 

4(  40) 
5(  50) 
2(  20) 
K  10) 


34 

32 


70 
80 


10(100) 

3(  30) 

1(  10) 
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2(  20) 

3  30) 
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44 

50 
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1(10) 

1(10) 
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5(50) 
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4(40) 
1(10) 
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1(10) 


4(40) 


8(  80] 

2(20) 

2 

:  2o; 

10(100] 

7(70) 

1 

:  io; 

1 

HO) 

7(  70] 

4(40) 

10 

;ioo; 

7 

70 

9 

90 

6 

60 

1 

10 

1 

10 

10 

9 

[90, 

10 


22 
26 


5(50) 


1(10) 


5(50) 
5(50) 


6(60) 
2(20) 

1(10) 
6(60) 
2(20) 
2(20) 
1(10) 


1(10) 


1(10) 

2(20) 

2(20) 

4(40) 

2(20) 

5(50) 

6  60 

4(40 

7(70) 


11 


44 

32 


Kio) 

2 

10(100) 

23 

i(  io) 

1 

2(  20) 

3 

5(  50) 

7 

5(  50) 

5 

2(  20) 

2 

1(  10) 

1 

2(20) 

14 

10(100) 

24 

3(30) 

10 

9(  90) 

25 

4(40) 

10(100) 

31 

2(20) 

5(  50) 

10 

Of     O  A  S 

2(  20) 

J 

5(  50) 
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2(20) 

9(  90) 

18 

1(10) 

4(  40) 
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1(10) 

71  70) 
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4(  40) 
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10  100  31 

9(  90  28 

4(  40)  4 
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50 
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SECTION  VI 
RESOURCES  AND  COST 
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INTRODUCTION  AND  METHOD 

This  section  presents  the  personnel  resources  used  by  BPSRO  in 
planning,  developing  and  operating  an  ambulatory  review  program  from 
October  1,  1976  to  June  30,  1978. 

Personnel  and  other  resources  for  specific  functions  are  analyzed 
to  present  trends  over  time  and  to  provide  some  indication  of  the 
resources  required  by  review  organizations  during  implementation  of 
ambulatory  review. 

To  develop  accurate  information  on  resource  use,  BPSRO  collected 
personnel  hours  spent  on  specific  activities  and  forwarded  the  informa- 
tion to  HCMS.    Three  conditions  suggested  special  procedures  for  record- 
ing and  collecting  personnel  hours: 

1.  Having  BPSRO  personnel  record  their  hours  was. likely  to 
increase  the  face  validity  of  the  information  collected. 

2.  Vouchered  cost  information  was  not  considered  reliable 
because  of  the  variety  of  PSRO  procedures  used  in  billing 
the  Health  Standards  and  Quality  Bureau  (HSQB). 

3.  Vouchered  personnel  information  frequently  does  not  contain 
volunteer  physician  time  and  overtime  which  are  required 
for  an  accurate  estimate  of  resource  use. 

In  collecting  resource  information  HCMS  and  the  PSRO  discussed 
systematic  recording  procedures,  developed  data  compilation  procedures 
and  defined  specific  terms  and  categories.    Participants  in  the  demon- 
stration project  were  asked  to  describe  their  ambulatory  review  activities 
and  record  the  number  of  hours  spent  on  a  daily  or  weekly  basis.  During 
initial  discussions,  HCMS  and  the  PSRO  developed  rigorous  procedures 
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for  collection  of  personnel  data,  and  a  monthly  activity  log  with  a 
standard  format  was  designed  to  record  information.    BPSRO  decided 
to  use  their  own  logs.    The  logs  and  all  minutes  of  meeting  were 
forwarded  to  HCMS  on  a  monthly  basis. 

Categorization  and  Compilation  of  Resource  Data 

To  facilitate  the  compilation  and  presentation  of  data,  HCMS  classi- 
fied the  information  contained  in  the  BPSRO  logs  into  a  standard  format 
composed  of  three  personnel  categories: 

1.  Physicians—including  physicians  working  either  in  staff 
capacity  or  as  special  panel  consultants. 

2.  Management/Technical 

a)  Management—all  personnel  assigned  the  responsibility 
to  administer  the  project  or  to  assist  in  managing 
the  project. 

b)  Technical --personnel  principally  engaged  in  technical 
design  of  the  project,  analysis  of  the  data,  providing 
liaison  with  data  processing,  etc. 

3.  Data  Collection/Clerical 

a)  Data  Collection— those  personnel  retrieving  data  from 
medical  record  charts,  transforming  and  coding  data 
for  subsequent  processing,  etc. 

b)  Clerical— secretarial  personnel  whose  duties  are  typing, 
filing  and  generally  supporting  the  project. 

Each  participant  in  the  demonstration  project  was  classified  into  one  or 
more  of  the  above  three  categories  depending  on  type  of  work  performed 
during  the  reporting  periods.    Where  the  choice  between  categories  2  and 
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3  was  not  clear,  persons  receiving  $7  or  more  per  hour  were  assigned 
to  the  Management/Technical  category  and  those  receiving  less  than  $7 
per  hour  to  the  Data  Collection/Clerical  category. 

Seven  major  functional  categories  were  identified  as  spanning 
the  work  effort  of  the  project  for  the  period  under  study.    The  seven 
functions  are: 

1.  Planning  and  Administration—includes  activities  relating 
to  system-wide  staffing  and  coordination,  system  design 
and  approach  and  the  administrative  support  activities 
that  facilitate  review  system  implementation. 

2.  Topic  Selection—work  related  to  identifying  problems  or 
topics  for  review  and  the  selection  of  those  topics  likely 
to  produce  the  greatest  benefit. 

3.  Criteria  Development—development  of  criteria  related  to 
the  problem  or  topic  under  study  which  can  be  measured  or 
compared  by  data  being  collected. 

4.  Data  Collection  (includes  abstracting)— activity  of  collect- 
ing information  from  required  data  sources. 

5.  Coding— acti vity  of  converting  abstracted  data  to  a  format 
acceptable  for  computer  entry. 

6.  Data  Processing  and  Analysis— acti vity  of  compiling,  organiz- 
ing and  displaying  data  in  preparation  for  professional 
interpretation.    The  processing  and  analysis  can  be  accomplished 
manually  or  by  machine.    The  analysis  activity  is  defined  as 
developing  statistics  from  data  collected  for  reviews. 

7.  Review  and  Decision  Making—professional  (physician  or 
other  staff)  examination  and  interpretation  of  processed 
information. 


HCMS  allocated  the  personnel  hours  reported  to  the  appropriate 
function  by  personnel  category.    Some  interpretive  judgments  were  made 
in  determining  which  function  most  closely  correlated  to  the  work 
done  as  reported  by  the  activity  logs.    One  HCMS  staff  member  allo- 
cated activities  to  the  appropriate  category,  and  two  other  staff 
members  reviewed  the  process  for  consistency. 

Information  used  in  assigning  resources  to  appropriate  functions 
and  categories  was  taken  solely  from  data  entered  by  personnel  on  the 
activity  log.    Often  BPSRO  personnel  described  an  activity  in  detail 
and  no  judgment  was  required  in  assigning  it  to  a  function. 

BPSRO  subcontract  personnel  were  allocated  in  the  same  manner  as 
BPSRO  personnel  and  are  included  in  the  aggregated  data  shown  in  the 
various  tables  and  figures. 

PRESENTATION  OF  RESOURCE  DATA 

The  distribution  of  total  personnel  hours  expended  by  the  project 
is  shown  in  Table  10  distributed  by  personnel  category  and  tabulated 
by  functional  category.    The  percent  of  personnel  resources  for  each 
of  the  functions  is  given  in  total  and  separately  by  personnel  category. 
Figure  4  is  a  graphic  representation  of  the  data  in  Table  10.    In  this 
graph,  the  percent  of  total  hours  worked  by  members  of  each  of  the 
three  personnel  categories  is  represented  horizontally  and  the  percent 
of  hours  used  for  each  functional  category  is  represented  vertically. 
Areas  within  the  bars  are  proportional  to  the  number  of  hours  expended 
by  any  one  personnel  category  for  any  one  function. 
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Table  11  presents  this  data  with  the  added  dimension  of  time. 
Personnel  hours  for  each  of  the  seven  functions  is  distributed  by 
personnel  category  and  tabulated  by  calendar  quarter  from  October 
1976  through  June  1978.    Percents  of  personnel  resources  used  for 
each  calendar  quarter  are  given  for  the  function  and  separately  by 
personnel  category. 
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TABLE  10:     DISTRIBUTION  OF  TOTAL  PERSONNEL  HOURS 
BY  FUNCTION  AND  PERSONNEL  CATEGORY 


PERSONNEL  CATEGORY 


MGMT7 

FUNCTION  MP    (%)    TECHNICAL  (%) 

Planning  and  Administration  229  (  36)  2,352  (  54) 

Topic  Selection  13  (  0) 

Criteria  Development  130  (21)  64  (  2) 

Data  Collection,  Abstracting  200  (32)  1,411  (33) 

Coding  65  (  10)  227  (  5) 

Data  Processing  270  (  6) 

Review  and  Decision  Making  6  (  1) 

TOTAL  630  (100)  4,337  (100) 
PERCENT   5%  33% 


DATA/ 

[%) 

CLERICAL  {%) 

TOTAL 

1,076  (  13) 

3,657 

(  28) 

13 

(  o) 

194 

(  2) 

3,288  (  40) 

4,899 

(  37) 

3,840  (  47) 

4,132 

(  31) 

270 

(  2) 

6 

(  0) 

8,204  (100) 

13,171 

(100) 

62% 

100% 
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FIGURE  4 

DISTRIBUTION  OF  TOTAL  PERSONNEL  HOURS  BY  FUNCTION  WITHIN  PERSONNEL  CATEGORY 
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TABLE  11:     DISTRIBUTION  OF  PERSONNEL  HOURS  FOR  FUNCTIONS 
BY  CALENDAR  QUARTER  AND  PERSONNEL  CATEGORY 


PERSONNEL  CATEGORY 


FUNCTION 


Planning  and 
Administration 


Topic  Selec- 
tion 


Criteria 
Development 


CALENDAR 

MGMT/ 

QUARTER 

MD  (%) 

TECHNICAL  (%) 

10-12/76 

37  (  16) 

412  (  18) 

1-3  /77 

37  (  16) 

258  (  11) 

4-6 

19  (  8 

144  (  6) 

7-9 

24  (  11) 

240  (  10) 

10-12 

23  (  10) 

332  (  14) 

1-3  /78 

22  (  10) 

493  (  21) 

4-6 

67  29 

473  20 

TOTAL 

229  (100) 

2,352  (100) 

PERCENT 

6% 

64% 

10-12/76 

8  (  62) 

1-3  /77 

5  (  38) 

4-6 

7-9 

10-12 

1-3  /78 

4-6 

TOTAL 

13  (100) 

PERCENT 

100% 

10-12/76 

13  (  10) 

46  (  72) 

1-3  /77 

73  (  56) 

15  (  23) 

4-6 

10  (  8) 

3  (  5) 

7-9 

34  (  26) 

10-12 

1-3  /78 

4-6 

TOTAL 

130  (100) 

64  (100) 

PERCENT 

67% 

33% 

DATA/ 

CLERICAL  (%) 

122  (  11) 

51  (  5) 

60  (  6) 

178  (  17) 

24  (  2) 

281  (  26) 

360  33 
1  ,076  (100 
30% 


TOTAL 


ill 


571  (  16) 

346  (  9) 

223  (  6) 

442  (  12) 

379  (  10) 

796  (  22) 
25) 


900 


3,657  (100; 
100% 


8  (  62) 
5  (  38) 


13  (100) 
100% 

59  (  30) 

88  (  45) 

13  (  7) 

34  (  18) 


194  (  100) 
100% 


Data  Collec- 

10-12/76 

14  (  7) 

90  (  6) 

104  (  2) 

tion 

1-3  /77 

24  (  12) 

273  (  19) 

332  (  10) 

629  (  13) 

4-6 

54  (  27) 

486  (  35) 

1,044  (  32) 

1,584  (  32) 

7-9 

31  (  15) 

430  (  31  ) 

788  (  24) 

1,249  (  25) 

10-12 

14  (  7) 

31  (  2) 

484  (  15) 

529  (  11) 

1-3  /78 

63  (  32) 

101  (  7) 

405  (  12) 

569  (  12) 

4-6 

235  7 

235       5  - 

TOTAL 

200  (100) 

1,411  (100) 

3,288  (100) 

4,899  (100) 

PERCENT 

4% 

29% 

67% 

100% 
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TABLE  11  (CONT'D) 


PERSONNEL  CATEGORY 


FUNCTION 


Coding 


CALENDAR 
QUARTER 

10-12/76 

1-3  111 

4-6 

7-9 
10-12 

1-3  /78 

4-6 
TOTAL 
PERCENT 


MGMT/  DATA/ 
MP    (%)    TECHNICAL  (%)      CLERICAL  (%) 


57  (  88) 
8  (  12) 

65  (100) 

2% 


33  (  15) 

75  (  33) 

46  (  20) 

73  (  32) 


227 


( 


5) 
9) 
7) 
11) 


198 

347  ( 

265  ( 

407  ( 

748  (  20) 
1  ,207  (  31  ) 

668  17) 
3,840  (100) 
93% 


TOTAL  (%) 


198 

(  5) 

347 

(  8) 

265 

(  6) 

440 

(  ID 

880 

(  21) 

1,261 

(  31) 

741 

j  18) 

4,132 

(100) 

100% 


Data  Proces- 
sing 


Review  and 
Decision  Making 


10-12/76 

1-3  /77 

4-6 

7-9 
10-12 

1-3  /78 

4-6 
TOTAL 
PERCENT 

10-12/76 

1-3  /77 

4-6 

7-9 
10-12 

1-3  /78 

4-6 
TOTAL 
PERCENT 


nop) 

vm 


56 

(  21) 

56 

214 

214 

270 

nop) 

270 

100% 


79: 


Too; 

100% 


6 

jlOOj 

6 

(100) 

100% 


100% 
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APPENDIX  A 

BRONX  PSRO  AMBULATORY  CARE  DATA  BASE 
INITIAL  WORKUP 
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BRONX  PSRO 
AMBULATORY  CARE  DATA  BASE 
INITIAL  WORKUP 


APPENDIX  A 


TOPICS 

1.  Hypertension 

2.  Congestive  Heart  Failure 

3.  Diabetes  Mellitus 

4.  Asthma  Pediatrics 


STUDY  TIME  FRAME 

Four  Years  --  All  Topics 


DATA  ELEMENT 


TOPIC 
2  3 


PATIENT  HISTORY 

1.  Diagnoses 

2.  Diagnostic  Classification 

3.  Severity 

4.  Number  of  Incidents 

5.  Number  of  Classification  Change 

6.  Number  of  CVA's 

7.  Rates 

8.  Broken  Appointment 

9.  Onset/Date 

10.  Medications 

11.  Family  History 

12.  Diet 

13.  Drug  Allergy 

14.  Frequency  of  Attacks 

15.  Progress  of  Symptom 

16.  School  Absence 

17.  Alcoholism 

18.  Drugs 

19.  Smoking 

20.  Disability 

21.  Occupation 

22.  Literacy 

23.  Allergy  Testing 

24.  Desensitization 

25.  Psychosocial  Adj. 

26.  Immunizations 

27.  Development 

28.  Medications 

29.  Lab  Data 

30.  Px  Data 


x 
x 

X 
X 

x 

X 
X 
X 
X 


X 
X 
X 
X 
X 
X 


X 
X 
X 


X 
X 
X 

X 
X 
X 
X 
X 
X 


X 
X 
X 
X 
X 
X 


X 
X 
X 


X 
X 
X 
X 

X 
X 
X 
X 
X 


X 
X 
X 
X 
X 
X 


X 
X 
X 


X 
X 
X 
X 


X 
X 
X 
X 
X 
X 


X 
X 
X 
X 
X 
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DATA  ELEMENTS  (cont'd) 


TOPIC 
12       3  4 


EXAM 

1.  Height 

2.  Weight 

3.  Blood  Pressure 

4.  Pulse  Rate  x      x      x  x 

5.  Respiratory  Rate  x 

6.  Obesity  Mentioned  in  lieu  of  Wt/Ht 

7.  Funduscopic  Exam 

8.  Heart  Exam 

9.  Lungs  Exam 

10.  Liver  Exam 

11.  Abdominal/Carotid  Bruits 

12.  Peripheral  Edema 

13.  Skin  Exam 

14.  Neuro  Exam 

15.  ENT  Exam 

16.  Leg  Exam 

17.  Feet  Exam 

18.  Temperature 

19.  Cardiovascular  Review 

20.  Renal  Function  Review 


X 

X 

X 

X 

X 

X 

x 

x 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

PHYSICAL  FINDINGS  -  SYMPTOM 


1.  Hyperglycemia  x 

2.  Diabetes  x 

3.  Weakness  -  Fatigue  x      x  x 

4.  Skin  x 

5.  Cardiac  x      x  x 

6.  UTI  x 

7.  PVD  x 

8.  Headaches  x      x  x 

9.  Mental  Disturbance  x 
10.  Better/Worse/NC  x      x  x 


LABORATORY,  X-RAY,  DIAGNOSTIC  TESTS 


1. 
2. 
3. 
4. 
5. 
6. 
7. 


CBC 

UA 

BUN 

Potassium 
EKG 

Chest  Film 
Lipids 


x 

X 
X 
X 
X 

x 
x 


x 
x 
x 
x 
x 
x 

X 


X 
X 
X 
X 

x 
x 
x 


X 
X 
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DATA  ELEMENTS  (cont'd) 


LABORATORY,  X-RAY,  DIAGNOSTIC  TESTS 
(cont'd) 

8.  Blood  Sugar/Glucose 

9.  Cultures 

10.  WBC 

11.  Stress  Test 

12.  Angiogram 

13.  Microscopic  UA 

14.  SGOT 

15.  NA/K 

16.  Cholesterol 

17.  Glucose  Tolerance  Test 

18.  FBS 

19.  Other  Labs 

20.  TB  Test 

21.  Sweat  Test 

22.  Immunoglob 


THERAPIES 

1.  Insulin 

2.  Digitalis 

3.  Diuretics 

4.  Non-D  Hypotensives 

5.  Hypotensives  and  Diuretics 

6.  Nitro/Propanolol 

7.  DBI 

8.  Oral  Hypo,  (other) 

9.  Heart  Med.  (other) 

10.  Tranquilizers 

11.  Anticoagulants 

12.  B  12 

13.  Bronchodilators 

14.  Antihistamine  -Expectorant 

15.  Cromolyn 

16.  Steroids 

17.  Other  Medication 


PATIENT  DISPOSITION 

1.  Initial 

2.  Referrals 

3.  Advice 

4.  Medications 


TOPIC 


DATA  ELEMENTS  (cont'd) 

1 

2 

3 

4 

PATIENT  DATA 

1.     Patient  I.D. 

X 

X 

X 

X 

2.     Birth  Rate 

X 

X 

X 

X 

3.  Sex 

X 

X 

X 

4.     Payment  Status 

x 

X 

X 

5.  Ethnic/Race 

X 

X 

X 

PROVIDER  DATA 

1.     Hospital  I.D. 

X 

X 

X 

X 

2.     Admission  Number 

X 

X 

X 

X 

3.     Admission/Discharge  Dates 

X 

X 

X 

X 

4.     Admission/Discharge  Class 

X 

X 

X 

5.  Death 

X 

X 

X 

X 

6.     Provider  I.D. 

X 

X 

X 

7.     Chart  Status 

X 

X 

X 

8.     Number  of  Ambulatory  Visits 

X 

X 

X 

X 

9.     Ambulatory  Visit  Date 

X 

X 

X 

X 

10.     Ambulatory  Sites,  I.D. 

X  ' 

X 

X 
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BRONX  PSRO 
ADMISSION  JUSTIFICATION  CRITERIA 


APPENDIX  B 


HYPERTENSION 

1.  Diastolic  B/P  > 110  mmHg 

2.  Failure  to  respond  to  anti-HP  therapy 

3.  Neurological  or  sensorium  abnormalities 

4.  Inv.  secondary  cause  of  hypertension  (e.g.,  renal,  ren-vasc, 
adrenal ) 

5.  Uncontrolled  CHF  or  renal  failing  (rising  BUN) 


CONGESTIVE  HEART  FAILURE 

1.  Diag.  or  susp.  pulmonary  edema 

2.  Newly  diagn.  CHF,  to  establ .  response  to  therapy 

3.  Unresponsive  to  outpatient  management  (pers  &  rec  sympt.  of 
dyspnea,  weakness,  edema 

4.  Diagnostic  adm. 

5.  Radiologic  evidence  of  CHF 

6.  Positive  physician  findings  of  gallop  rhythm,  venous  HP  or 
Edema  or  enlarged  heart 


ARTERIOSCLEROTIC  HEART  DISEASE 

1.  Diagnosis  of  unstable  angina  pectoris  (incl.  new  AP) 

2.  Schedule  for  coronary  angiography 

3.  Angina  refractory  to  med.  mgmt 

4.  Sched  for  operation 

5.  EKG  confirmation  of  MI 

6.  Positive  EKG-stress/EKG-rest 

7.  Coronary  angiograph  confirmation 

8.  Persistent  recurrent  angina 

9.  Cardiac  arrythmias 

10.  Complications  -  diag.  proc  and  post-op  proc. 


DIABETES  MELLITUS 

1.  Uncontrolled  diabetes  (hypertension,  sugar  > 300  mg.  or  hypo., 
sugar  <  80  mg. ) 

2.  Pregnancy 

3.  Uncontrolled  vomiting  (>2  times  in  24  hours) 

4.  Uncontrolled  infection  (lymph,  spread  and  syst.  toxicity, 
chiols,  prostate,  severe  headache) 

5.  Acidosis,  ketoacidosis,  lactic  acidosis  w/o  coma.,  pC0?<15  mg., 
pH>7.3 
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DIABETES  MELLITUS  (cont'd) 


6.  Coma  in  hyperosmolar  state 

7.  Nephropathy  (a)  Nephrotic  syndrome  or  workup  (b)  Uremia. 
BUN  ^  at  60  orts  asympt  or  >100  sympt. 

8.  Major  neuropathy  (a)  visceral  (b)  peripheral 

9.  Cellulitis 
10.  Osteomyelitis 


ASTHMA  PEDIATRICS 

1.  Status  asthmaticus 

2.  Cyanosis 

3.  Recurring  attacks,  in  spite  of  temp,  relief 

4.  Pulmonary  complications 

5.  Failure  to  respond  to  office  or  OPD 
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BRONX  PSRO  STAGING  CRITERIA 


APPENDIX  C 


Table  1  lists  criteria  for  determining  the  stage  of  the  disease 
for  hypertension,  diabetes  and  congestive  heart  failure  (CHF).  Four 
classes  are  used.    These  classes  are  identified  for  each  hospitalization 
in  the  study  at  time  of  admission  and  time  of  discharge  and  are  recorded 
in  the  HOSPITAL  data  file  (card  10)  separately  for  each  hospitalization. 

CARD  COLUMNS   


TOPIC  ADMISSION  DISCHARGE  AMB.  SAME  DAY 
Hypertension                                       25                   50  57 
Diabetes                                             26                   51  58 

CHF  31  52 

The  class  codes  A,B,C,D  are  recorded  as  1,2,3,4.    The  admission  and  discharge 
class  for  the  primary  diagnosis  for  the  key  hospitalization  is  repeated 
in  the  PATIENT  data  file  (card  01)  columns  28  and  29. 

A  similar  set  of  criteria  is  used  to  identify  degree  of  severity 
for  ambulatory  visits  and  is  shown  in  Table  2.    The  three  or  four  classes 
of  severity  are  based  upon  a  full  year  of  ambulatory  visit  data  counting 
back  from  the  key  hospitalization.    Class  codes  are  recorded  for  each 
patient  ambulatory  year  in  the  AMBULATORY  SUMMARY  data  file  (card  41) 
in  the  following  columns: 

TOPIC  COLUMNS 

Hypertension  22  -  23 

Diabetes  20  -  21 

CHF  24  -  25 

Angina/Mi/Cad  26-27 

PVD  28  -  29 
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Classification  is  based  on  67%  or  more  of  the  ambulatory  contacts  during 
the  year  or  the  median  (if  no  class  covers  two-thirds  of  the  visits). 
Where  there  are  visits  but  no  laboratory  values,  the  class  is  estimated 
from  values  in  the  year  before  and  the  year  after. 
Codes  used  on  the  card  are: 


ANGINA  OTHER 

CLASS  CLASSES  PRIMARY  SECONDARY 

1+2  1  10  05 

3  2  15  07 

4  3  20  09 


A  third  set  of  staging  criteria  is  used  for  the  definition  of  an 
"incident."    An  ambulatory  visit  in  which  one  or  more  of  these  criteria  are 
noted  is  referred  to  as  an  incident  and  is  described  in  detail  in  the 
INCIDENTS  data  file  (diabetes  card  43,  hypertension  card  44,  heart  card 
45).    The  number  of  hypertensive  incidents  is  also  recorded  in  column 
55,  diabetes  56  and  heart  57  of  the  AMBULATORY  PROVIDER  SUMMARY  data 
file  (card  42). 

In  combination,  these  criteria  provide  a  continuing  estimate  of 
the  severity  of  the  disease  or  diseases  for  each  patient  for  as  many 
as  five  years  with  a  general  estimate  of  the  severity  for  each  of  four 
years  prior  to  the  key  hospitalization  and  for  one  year  following,  a 
two-way  (incident/  nonincident)  estimate  of  the  severity  at  each  ambulatory 
visit,  and  a  fourfold  classification  at  time  of  admission  and  discharge 
for  each  hospitalization  noted  during  the  study  period. 
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TABLE  1 


BRONX  STAGING  CRITERIA 
ADMISSION/DISCHARGE  CLASS  (HOSPITAL) 


CLASS 


HYPERTENSION 


DIABETES 


CHF 


Blood  Pressure: 
systolic  <  150 
and  diastolic  <  95 


FBS  65  to  199  and  Free  of  symptoms,  or  at  most, 

urines  >  2+  Mild  dyspnea  on  exertion 

Cardiac  enlargement 


Blood  Pressure: 

systolic  150  to  179 
or  diastolic  95  to  109 

(code  most  severe  class) 


FBS  <  65 


In  addition,  any  of: 
Paroxysmal  nocturnal  dyspnea 
Orthopnea 
Occasional  rales 
Shortness  of  breath 
Minimal  pedal dema 


Blood  Pressure: 

systolic  180  to  250 
or  diastolic  110  to  140 

(code  most  severe  class) 


FBS  200  to  300 
or  urines  3+ 


In  addition,  any  of: 
Persistent  rales 
Enlarged  liver 
Enlarged  neck  veins 
X-ray;  blunting  of  angles 
++Edema 
Gallop 

Increased  Dyspnea 


Blood  Pressure: 
systolic  >  250 
diastolic  >  140 

(code  most  severe  class) 


FBS  >  300 
or  urines  4+ 
or  Ketoacidosis 


In  addition,  any  of: 
Pleural  effusion 
Severe  dyspnea  at  rest 


BRONX  STAGING  CRITERIA 


TABLE  2 


DEGREE  OF  SEVERITY 


(AMBULATORY) 


Based  on  Data  for  One  Year 


HYPERTENSION 


DIABETES 


Class 
1. 


Systolic  under  150 
AND 

Diastolic  under  95 

Systolic  150  to  179 
OR 

Diastolic  95  to  109 

Systolic  180  to  250 
OR 

Diastolic  110  to  140 


Class 
1 


FBS  from  60  to  199  and 
urines  negative  through 
2+ 

FBS  200  to  300,  no  matter 
what  urine  measures 
OR 

No  measure  of  blood  sugar, 
3+  or  4+  urines 

FBS  301  to  450 


The  figures  coded  are  those  seen  in  67  percent  or  more 
of  the  ambulatory  contacts.    If  that  has  not 
occurred,  use  the  median. 

When  there  had  been  visits  but  no  laboratory  readings, 
average  the  last  reading  of  the  year  before  and  the 
first  one  of  the  next  year;  these  readings  may  be 
ambulatory  or  on  hospital  discharge  but  not  on  hos- 
pital admission.    For  the  first  year  or  the  last, 
use  99. 

(Ambulatory  includes  emergency  room.) 


 HEART  

Class  (CHF) 

la    Free  of  symptoms 
b    Mild  dyspnea  on  exertion 
c    Cardiac  enlargement 

2  b  and  c  above  and/or 
Paroxysmal  nocturnal  dyspnea 
Orthopnea 

Occasional  rales 
Shortness  of  breath 
Minimal  pedal  edema 

3  Any  of  above  plus: 
Persistent  rales 
++Edema 

Enlarged  liver 
Enlarged  neck  veins 
Gallop 

Increased  dyspnea 
X-ray:    blunting  of  angles 
(minimal  effusion) 

(ANGINA/MI/CAD) 

1  Free  of  pain 

2  Pain  on  minimum  exertion 

3  Pain  on  moderate  exertion- 

Unspecified  pain  (22) 

4  Pain  at  rest 

(PVD) 

1  Foot  ulcers,  numbness,  coldness 

2  Dry  gangrene  without  tissue 
breakdown  or  infection 

3  Extensive  wet  gangrene  with 
infection  and  tissue  breakdown, 
involving  >2  toes,  >1  extremity 
or  >  pressure  necrosis  of 

pressure  points 


BRONX  STAGING  CRITERIA 

DEFINITION  OF  INCIDENT     ONE  OR  MORE  OF  THE  CONDITIONS  LISTED  (AMBULATORY) 


HYPERTENSION 


10  point  rise  in  diastolic  pressure 
held  for  2  consecutive  visits  or 
more 

20  point  rise  in  systolic  pressure 
held  for  2  consecutive  visits  or 
more 

BUN  rise  at  15  points  or  more 
Potassium  <  3 

Positive  findings  in  fundi  exam 

Any  of  these  symptoms: 

dizziness,  fainting  spells, 
mental  confusion/nightmare/ 
bizarre  behavior 

Systolic  over  250 

Diastolic  over  140 


DIABETES 


Jump  in  severity  from  1  to  3 

Jump  from  3  to  1 

Blood  sugar  below  60 

Acetone  2+  or  higher 

Blood  sugar  >  450 

Any  of  these  symptoms: 
excessive  hunger/nausea 
unintentional  weight  loss, 
polydipsia,  polyuria 


HEART 


(CHF) 

Severity  changes  up  or  down,  for  CHF 
AND 

Pleural  effusion  (noted  on  physical 

examination) 
Severe  dyspnea  at  rest 

(ANGINA/MI/CAD) 

Severity  changes 

(PVD) 

Severity  changes 
(CVAs) 


Increased  rales  in  lungs  mentioned 
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APPENDIX  D 

PAGE  1 

MARGINAL  FREQUENCY  TABLES 

TABLE  NUMBER  21-13 

MARGINAL  FREQUENCY  TABLE  FOR  ALCO-HIST-A  IN  FILE  AMBWU 
ON  08/29/78 

RESULTS 

NEGATIVE     NO   ENTRY  POSITIVE 
READMIT  TOTAL 

~0~  3  65  2  70 

1  7  352  22  381 

TOTAL  10  417  24  451 


APPENDIX  D  (CONT'D) 

PAGE  1 

mJrgFnALMFREmJENCY  TABLE  F3R  DAT  E-E ARLV I S  IN  FILE  AMBWU 
ON  08/29/78 

NUMBER  OF 
READMIT     DATE-EARLVIS     AMB.  VISITS 
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